2025-12-05 20:00:22 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 20:00:22 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 20:00:22 [auto1.it] INFO: Starting spider auto1.it
2025-12-05 20:00:22 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 20:00:22 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 20:00:22 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 20:00:22 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 20:00:22 [scrapy.extensions.telnet] INFO: Telnet Password: e748940ed5f2b7f7
2025-12-05 20:00:22 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 20:00:22 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_75_2025-12-05T20_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 20:00:22 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 20:00:22 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 20:00:22 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 20:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 20:00:22 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 20:00:23 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 20:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:00:23 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 20:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 20:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:23 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 20:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 20:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 20:00:23 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 20:00:23 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 20:00:23 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 20:00:23 [scrapy.core.engine] INFO: Spider opened
2025-12-05 20:00:23 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 20:00:23 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2025-12-05 20:00:23 [scrapy-playwright] INFO: Starting download handler
2025-12-05 20:00:23 [scrapy-playwright] INFO: Starting download handler
2025-12-05 20:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2025-12-05 20:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2025-12-05 20:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2025-12-05 20:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2025-12-05 20:00:41 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: EH50837
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH50837%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for EH50837: 2
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: VE11407
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE11407%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for VE11407: 1
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: XM76789
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM76789%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for XM76789: 2
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: DE99419
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE99419%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for DE99419: 2
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: LW50261
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW50261%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for LW50261: 2
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: YD46030
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46030%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for YD46030: 2
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: EK97889
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK97889%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for EK97889: 2
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: YD04082
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD04082%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for YD04082: 2
2025-12-05 20:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: AB13595
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB13595%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for AB13595: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: UU64111
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64111%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for UU64111: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: DX87902
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX87902%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for DX87902: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: YM94819
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM94819%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for YM94819: 1
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: SX24290
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX24290%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for SX24290: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: TH75264
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH75264%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for TH75264: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: JR02113
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02113%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for JR02113: 1
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: KR41541
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR41541%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for KR41541: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: US78737
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US78737%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for US78737: 1
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: RX45819
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX45819%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for RX45819: 1
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: BD13834
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD13834%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for BD13834: 0
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: WF89394
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF89394%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for WF89394: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: HP29933
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP29933%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for HP29933: 1
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: EH65548
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH65548%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for EH65548: 1
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: VU11747
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11747%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for VU11747: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: GU76780
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU76780%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for GU76780: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: ED77017
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77017%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for ED77017: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: WD58389
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD58389%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for WD58389: 1
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: WW19870
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19870%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [auto1.it] INFO: Scrape type for WW19870: 2
2025-12-05 20:00:41 [auto1.it] INFO: Found listing with ID: PW60700
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW60700%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for PW60700: 2
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: UK96914
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK96914%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for UK96914: 1
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: JB89811
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB89811%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for JB89811: 0
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: CM21448
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM21448%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for CM21448: 1
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: DL80680
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL80680%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for DL80680: 2
2025-12-05 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE11407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: LX26902
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX26902%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for LX26902: 0
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: NZ68361
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ68361%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for NZ68361: 2
2025-12-05 20:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: JX61108
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX61108%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for JX61108: 0
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: HW64559
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for HW64559: 0
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: HV38513
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV38513%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for HV38513: 0
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: KW26134
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW26134%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for KW26134: 0
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: TZ24707
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for TZ24707: 2
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: XD59619
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD59619%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for XD59619: 0
2025-12-05 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM76789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD46030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE99419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:42 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: EH50837
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH50837%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for EH50837: 2
2025-12-05 20:00:42 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/EH50837/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: VE11407
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: XM76789
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM76789%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for XM76789: 2
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: DE99419
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE99419%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for DE99419: 2
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: LW50261
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW50261%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for LW50261: 2
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: YD46030
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46030%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for YD46030: 2
2025-12-05 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW50261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK97889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: EK97889
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK97889%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for EK97889: 2
2025-12-05 20:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: YD04082
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD04082%27 HTTP/1.1" 200 None
2025-12-05 20:00:42 [auto1.it] INFO: Scrape type for YD04082: 2
2025-12-05 20:00:42 [auto1.it] INFO: Found listing with ID: AB13595
2025-12-05 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB13595%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for AB13595: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: UU64111
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64111%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for UU64111: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: DX87902
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX87902%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for DX87902: 2
2025-12-05 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH50837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: YM94819
2025-12-05 20:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: SX24290
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX24290%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for SX24290: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: TH75264
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH75264%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for TH75264: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: JR02113
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: KR41541
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR41541%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for KR41541: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: US78737
2025-12-05 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD04082/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: RX45819
2025-12-05 20:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: BD13834
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD13834%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for BD13834: 0
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: WF89394
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF89394%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for WF89394: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: HP29933
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: EH65548
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: VU11747
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11747%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for VU11747: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: GU76780
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU76780%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for GU76780: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: ED77017
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77017%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for ED77017: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: WD58389
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: WW19870
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19870%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for WW19870: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: PW60700
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW60700%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for PW60700: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: UK96914
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: JB89811
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB89811%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for JB89811: 0
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: CM21448
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: DL80680
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL80680%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for DL80680: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: LX26902
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX26902%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for LX26902: 0
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: NZ68361
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ68361%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for NZ68361: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: JX61108
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX61108%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for JX61108: 0
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: HW64559
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for HW64559: 0
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: HV38513
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV38513%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for HV38513: 0
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: KW26134
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW26134%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for KW26134: 0
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: TZ24707
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for TZ24707: 2
2025-12-05 20:00:43 [auto1.it] INFO: Found listing with ID: XD59619
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD59619%27 HTTP/1.1" 200 None
2025-12-05 20:00:43 [auto1.it] INFO: Scrape type for XD59619: 0
2025-12-05 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX87902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM94819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX24290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR02113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH75264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB13595/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ24707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE11407> (referer: https://www.auto1.com/v1/car-details-view/VE11407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD46030> (referer: https://www.auto1.com/v1/car-details-view/YD46030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89cf1bce-6291-530d-8432-c8005f0bbe21 with identifier: VE11407
2025-12-05 20:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cf1bce-6291-530d-8432-c8005f0bbe21 with scrape type 1
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 89cf1bce-6291-530d-8432-c8005f0bbe21
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_092303232b0da629276579b8f0ed50a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_092303232b0da629276579b8f0ed50a0.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_ac2b68771fa2594ca475500de1896985.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_ac2b68771fa2594ca475500de1896985.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_5498481c18e491daa8878a2cbe275616.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_5498481c18e491daa8878a2cbe275616.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_88198fce1d9f0ba82a469cbe76cfbe9e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_88198fce1d9f0ba82a469cbe76cfbe9e.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_e6a9faba19abfdc9a5338de5808d9d07.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_e6a9faba19abfdc9a5338de5808d9d07.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_3b7fccacfb3e2e816adc5fd74fd2451a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_3b7fccacfb3e2e816adc5fd74fd2451a.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_792643db9ddf6e16c1efdc752c98e151.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_792643db9ddf6e16c1efdc752c98e151.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_a2c9b5a8b8a08c1844cc6e73b0d9163e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_a2c9b5a8b8a08c1844cc6e73b0d9163e.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_8a8357c8ea81b7e6c08e98cd97f3a8a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_8a8357c8ea81b7e6c08e98cd97f3a8a8.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_6fb4e21fa01fb0fcb02a7ae8ffae7e22.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_6fb4e21fa01fb0fcb02a7ae8ffae7e22.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_8bf092cdf5d38cc38b2ec7e30f5eb833.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_8bf092cdf5d38cc38b2ec7e30f5eb833.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_1f6d1ba902c0732a2f343d9327dfbb60.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_1f6d1ba902c0732a2f343d9327dfbb60.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_7e2d706373e6fd452fb374ddd37b0872.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_7e2d706373e6fd452fb374ddd37b0872.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_5d67acf89700fc02abc49b26d1521e18.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_5d67acf89700fc02abc49b26d1521e18.jpg already downloaded
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F6a%252Faa6a75a85320adcfe33f93c553b7c616%252Fpa%252FVE11407_0595be261da3829da2ce021fa8d30875.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_0595be261da3829da2ce021fa8d30875.jpg already downloaded
2025-12-05 20:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89cf1bce-6291-530d-8432-c8005f0bbe21, identifier: VE11407
2025-12-05 20:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89cf1bce-6291-530d-8432-c8005f0bbe21 with identifier: VE11407
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2025-12-05 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2025-12-05 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89cf1bce-6291-530d-8432-c8005f0bbe21 with identifier: VE11407
2025-12-05 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151714 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151714
2025-12-05 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 89cf1bce-6291-530d-8432-c8005f0bbe21 spider: auto1.it
2025-12-05 20:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 89cf1bce-6291-530d-8432-c8005f0bbe21 due to rule: high_mileage_for_country.json, error: 151714 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151714
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:53:02Z',
 'fuel_type': 'diesel',
 'id': '89cf1bce-6291-530d-8432-c8005f0bbe21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE11407',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 151714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_092303232b0da629276579b8f0ed50a0.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_ac2b68771fa2594ca475500de1896985.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_5498481c18e491daa8878a2cbe275616.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_88198fce1d9f0ba82a469cbe76cfbe9e.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_e6a9faba19abfdc9a5338de5808d9d07.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_3b7fccacfb3e2e816adc5fd74fd2451a.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_792643db9ddf6e16c1efdc752c98e151.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_a2c9b5a8b8a08c1844cc6e73b0d9163e.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_8a8357c8ea81b7e6c08e98cd97f3a8a8.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_6fb4e21fa01fb0fcb02a7ae8ffae7e22.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_8bf092cdf5d38cc38b2ec7e30f5eb833.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_1f6d1ba902c0732a2f343d9327dfbb60.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_7e2d706373e6fd452fb374ddd37b0872.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_5d67acf89700fc02abc49b26d1521e18.jpg',
                'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_0595be261da3829da2ce021fa8d30875.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3189395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_092303232b0da629276579b8f0ed50a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_ac2b68771fa2594ca475500de1896985.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_5498481c18e491daa8878a2cbe275616.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_88198fce1d9f0ba82a469cbe76cfbe9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3141694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_e6a9faba19abfdc9a5338de5808d9d07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59104,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_3b7fccacfb3e2e816adc5fd74fd2451a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56332,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_792643db9ddf6e16c1efdc752c98e151.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59718,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_a2c9b5a8b8a08c1844cc6e73b0d9163e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3101353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_8a8357c8ea81b7e6c08e98cd97f3a8a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3174810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_6fb4e21fa01fb0fcb02a7ae8ffae7e22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276050,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_8bf092cdf5d38cc38b2ec7e30f5eb833.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47711,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_1f6d1ba902c0732a2f343d9327dfbb60.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_7e2d706373e6fd452fb374ddd37b0872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265421,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_5d67acf89700fc02abc49b26d1521e18.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cf1bce-6291-530d-8432-c8005f0bbe21/89cf1bce-6291-530d-8432-c8005f0bbe21_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/6a/aa6a75a85320adcfe33f93c553b7c616/pa/VE11407_0595be261da3829da2ce021fa8d30875.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic AMG Sport',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Sport',
 'year': 2017}
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE11407%27 HTTP/1.1" 200 None
2025-12-05 20:00:46 [auto1.it] INFO: Saving data for VE11407: {'created_time': 1764964846.493863, 'last_price_update_time': 1764964846.493874, 'auction_closing_time': 1765039982.0}
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VE11407') HTTP/1.1" 204 0
2025-12-05 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL80680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM76789> (referer: https://www.auto1.com/v1/car-details-view/XM76789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE99419> (referer: https://www.auto1.com/v1/car-details-view/DE99419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f6c28e6-d813-5cbb-81b6-2c828e127dd5 with identifier: YD46030
2025-12-05 20:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f6c28e6-d813-5cbb-81b6-2c828e127dd5 with scrape type 2
2025-12-05 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f6c28e6-d813-5cbb-81b6-2c828e127dd5 with scrape type 2
2025-12-05 20:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1f6c28e6-d813-5cbb-81b6-2c828e127dd5, identifier: YD46030
2025-12-05 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1f6c28e6-d813-5cbb-81b6-2c828e127dd5 with identifier: YD46030
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2025-12-05 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1f6c28e6-d813-5cbb-81b6-2c828e127dd5 with identifier: YD46030
2025-12-05 20:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1f6c28e6-d813-5cbb-81b6-2c828e127dd5 with identifier: YD46030 to the API
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YD46030>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:37:20Z',
 'fuel_type': 'petrol',
 'id': '1f6c28e6-d813-5cbb-81b6-2c828e127dd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD46030',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 100399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Advance S&S',
 'transmission': 'manual',
 'trim': 'Advance S&S',
 'year': 2019}
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46030%27 HTTP/1.1" 200 None
2025-12-05 20:00:47 [auto1.it] INFO: Saving data for YD46030: {'auction_closing_time': 1765039040.0, 'created_time': 1762891304.289545, 'last_price_update_time': 1764964847.274797}
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD46030') HTTP/1.1" 204 0
2025-12-05 20:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dd2407f-4848-514e-8f84-3e2394c74870 with identifier: XM76789
2025-12-05 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dd2407f-4848-514e-8f84-3e2394c74870 with scrape type 2
2025-12-05 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dd2407f-4848-514e-8f84-3e2394c74870 with scrape type 2
2025-12-05 20:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1dd2407f-4848-514e-8f84-3e2394c74870, identifier: XM76789
2025-12-05 20:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12de6e2f-e3e1-5b1f-805e-3133d809e0da with identifier: DE99419
2025-12-05 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12de6e2f-e3e1-5b1f-805e-3133d809e0da with scrape type 2
2025-12-05 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12de6e2f-e3e1-5b1f-805e-3133d809e0da with scrape type 2
2025-12-05 20:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12de6e2f-e3e1-5b1f-805e-3133d809e0da, identifier: DE99419
2025-12-05 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1dd2407f-4848-514e-8f84-3e2394c74870 with identifier: XM76789
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2025-12-05 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1dd2407f-4848-514e-8f84-3e2394c74870 with identifier: XM76789
2025-12-05 20:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1dd2407f-4848-514e-8f84-3e2394c74870 with identifier: XM76789 to the API
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XM76789>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:45:23Z',
 'fuel_type': 'diesel',
 'id': '1dd2407f-4848-514e-8f84-3e2394c74870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM76789',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 49157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM76789%27 HTTP/1.1" 200 None
2025-12-05 20:00:48 [auto1.it] INFO: Saving data for XM76789: {'auction_closing_time': 1765039523.0, 'created_time': 1763366469.628853, 'last_price_update_time': 1764964848.122683}
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XM76789') HTTP/1.1" 204 0
2025-12-05 20:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12de6e2f-e3e1-5b1f-805e-3133d809e0da with identifier: DE99419
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2025-12-05 20:00:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2025-12-05 20:00:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12de6e2f-e3e1-5b1f-805e-3133d809e0da with identifier: DE99419
2025-12-05 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182832 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182832
2025-12-05 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 12de6e2f-e3e1-5b1f-805e-3133d809e0da spider: auto1.it
2025-12-05 20:00:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 12de6e2f-e3e1-5b1f-805e-3133d809e0da due to rule: high_mileage_for_country.json, error: 182832 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182832
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:35:07Z',
 'fuel_type': 'gas',
 'id': '12de6e2f-e3e1-5b1f-805e-3133d809e0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE99419',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 182832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TGI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2020}
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE99419%27 HTTP/1.1" 200 None
2025-12-05 20:00:48 [auto1.it] INFO: Saving data for DE99419: {'auction_closing_time': 1765038907.0, 'created_time': 1762632236.162753, 'last_price_update_time': 1764964848.805052}
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE99419') HTTP/1.1" 204 0
2025-12-05 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD04082> (referer: https://www.auto1.com/v1/car-details-view/YD04082/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW50261> (referer: https://www.auto1.com/v1/car-details-view/LW50261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK97889> (referer: https://www.auto1.com/v1/car-details-view/EK97889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:48 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:00:48 [auto1.it] INFO: Found listing with ID: GG19645
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG19645%27 HTTP/1.1" 200 None
2025-12-05 20:00:48 [auto1.it] INFO: Scrape type for GG19645: 0
2025-12-05 20:00:48 [auto1.it] INFO: Found listing with ID: XX17565
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX17565%27 HTTP/1.1" 200 None
2025-12-05 20:00:48 [auto1.it] INFO: Scrape type for XX17565: 2
2025-12-05 20:00:48 [auto1.it] INFO: Found listing with ID: ZE44848
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE44848%27 HTTP/1.1" 200 None
2025-12-05 20:00:49 [auto1.it] INFO: Scrape type for ZE44848: 0
2025-12-05 20:00:49 [auto1.it] INFO: Found listing with ID: CU64074
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU64074%27 HTTP/1.1" 200 None
2025-12-05 20:00:49 [auto1.it] INFO: Scrape type for CU64074: 0
2025-12-05 20:00:49 [auto1.it] INFO: Found listing with ID: GE32816
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE32816%27 HTTP/1.1" 200 None
2025-12-05 20:00:49 [auto1.it] INFO: Scrape type for GE32816: 0
2025-12-05 20:00:49 [auto1.it] INFO: Found listing with ID: SJ43277
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ43277%27 HTTP/1.1" 200 None
2025-12-05 20:00:49 [auto1.it] INFO: Scrape type for SJ43277: 2
2025-12-05 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe75472e-3f9e-5fbf-aa37-d838b24e77c4 with identifier: YD04082
2025-12-05 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe75472e-3f9e-5fbf-aa37-d838b24e77c4 with scrape type 2
2025-12-05 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe75472e-3f9e-5fbf-aa37-d838b24e77c4 with scrape type 2
2025-12-05 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe75472e-3f9e-5fbf-aa37-d838b24e77c4, identifier: YD04082
2025-12-05 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821235f4-36c8-56be-a036-cc4769e10b51 with identifier: LW50261
2025-12-05 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821235f4-36c8-56be-a036-cc4769e10b51 with scrape type 2
2025-12-05 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 821235f4-36c8-56be-a036-cc4769e10b51 with scrape type 2
2025-12-05 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 821235f4-36c8-56be-a036-cc4769e10b51, identifier: LW50261
2025-12-05 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe75472e-3f9e-5fbf-aa37-d838b24e77c4 with identifier: YD04082
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2025-12-05 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe75472e-3f9e-5fbf-aa37-d838b24e77c4 with identifier: YD04082
2025-12-05 20:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe75472e-3f9e-5fbf-aa37-d838b24e77c4 with identifier: YD04082 to the API
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YD04082>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:35:16Z',
 'fuel_type': 'petrol',
 'id': 'fe75472e-3f9e-5fbf-aa37-d838b24e77c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD04082',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 84010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2019}
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD04082%27 HTTP/1.1" 200 None
2025-12-05 20:00:49 [auto1.it] INFO: Saving data for YD04082: {'auction_closing_time': 1765038916.0, 'created_time': 1763064050.122673, 'last_price_update_time': 1764964849.995591}
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD04082') HTTP/1.1" 204 0
2025-12-05 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 821235f4-36c8-56be-a036-cc4769e10b51 with identifier: LW50261
2025-12-05 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 821235f4-36c8-56be-a036-cc4769e10b51 with identifier: LW50261
2025-12-05 20:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 821235f4-36c8-56be-a036-cc4769e10b51 with identifier: LW50261 to the API
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LW50261>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2025-12-06T16:59:25Z',
 'fuel_type': 'petrol',
 'id': '821235f4-36c8-56be-a036-cc4769e10b51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW50261',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 69584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW50261%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Saving data for LW50261: {'auction_closing_time': 1765040365.0, 'created_time': 1762254210.272159, 'last_price_update_time': 1764964850.399417}
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW50261') HTTP/1.1" 204 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: XR03874
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR03874%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for XR03874: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: SB13925
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB13925%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for SB13925: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: ZK51756
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK51756%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for ZK51756: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: GF33342
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF33342%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for GF33342: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: YB62533
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB62533%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for YB62533: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: UD94632
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD94632%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for UD94632: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: MR53834
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR53834%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for MR53834: 2
2025-12-05 20:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 103706a1-b103-52b6-a8e5-5736be161b12 with identifier: EK97889
2025-12-05 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 103706a1-b103-52b6-a8e5-5736be161b12 with scrape type 2
2025-12-05 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 103706a1-b103-52b6-a8e5-5736be161b12 with scrape type 2
2025-12-05 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 103706a1-b103-52b6-a8e5-5736be161b12, identifier: EK97889
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: UX72610
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX72610%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for UX72610: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: RM85367
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM85367%27 HTTP/1.1" 200 None
2025-12-05 20:00:50 [auto1.it] INFO: Scrape type for RM85367: 0
2025-12-05 20:00:50 [auto1.it] INFO: Found listing with ID: MU15343
2025-12-05 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU15343%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for MU15343: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: AR46533
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR46533%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for AR46533: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: KH83938
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH83938%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for KH83938: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: CR95070
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR95070%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for CR95070: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: XY45470
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY45470%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for XY45470: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: LP81451
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP81451%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for LP81451: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: FP59077
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP59077%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for FP59077: 2
2025-12-05 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX24290> (referer: https://www.auto1.com/v1/car-details-view/SX24290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX87902> (referer: https://www.auto1.com/v1/car-details-view/DX87902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH50837> (referer: https://www.auto1.com/v1/car-details-view/EH50837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 103706a1-b103-52b6-a8e5-5736be161b12 with identifier: EK97889
2025-12-05 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 103706a1-b103-52b6-a8e5-5736be161b12 with identifier: EK97889
2025-12-05 20:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 103706a1-b103-52b6-a8e5-5736be161b12 with identifier: EK97889 to the API
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK97889>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:21:15Z',
 'fuel_type': 'diesel',
 'id': '103706a1-b103-52b6-a8e5-5736be161b12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK97889',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 73298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK97889%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Saving data for EK97889: {'auction_closing_time': 1765038075.0, 'created_time': 1764669725.496181, 'last_price_update_time': 1764964851.477684}
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EK97889') HTTP/1.1" 204 0
2025-12-05 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: HW41289
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW41289%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for HW41289: 1
2025-12-05 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU64111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: HY82993
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82993%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for HY82993: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: WD98953
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for WD98953: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: MD81052
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD81052%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for MD81052: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: AT29817
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT29817%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for AT29817: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: SS33960
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS33960%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for SS33960: 0
2025-12-05 20:00:51 [auto1.it] INFO: Found listing with ID: XV25208
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25208%27 HTTP/1.1" 200 None
2025-12-05 20:00:51 [auto1.it] INFO: Scrape type for XV25208: 2
2025-12-05 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 368760c0-bbff-5f09-85f7-35d8a5b02d93 with identifier: SX24290
2025-12-05 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 368760c0-bbff-5f09-85f7-35d8a5b02d93 with scrape type 2
2025-12-05 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 368760c0-bbff-5f09-85f7-35d8a5b02d93 with scrape type 2
2025-12-05 20:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 368760c0-bbff-5f09-85f7-35d8a5b02d93, identifier: SX24290
2025-12-05 20:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8cc8645-0f60-50f8-9c4a-2b7961166855 with identifier: DX87902
2025-12-05 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cc8645-0f60-50f8-9c4a-2b7961166855 with scrape type 2
2025-12-05 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8cc8645-0f60-50f8-9c4a-2b7961166855 with scrape type 2
2025-12-05 20:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8cc8645-0f60-50f8-9c4a-2b7961166855, identifier: DX87902
2025-12-05 20:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3084210a-597d-5112-b30c-eb52f30a9be3 with identifier: EH50837
2025-12-05 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3084210a-597d-5112-b30c-eb52f30a9be3 with scrape type 2
2025-12-05 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3084210a-597d-5112-b30c-eb52f30a9be3 with scrape type 2
2025-12-05 20:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3084210a-597d-5112-b30c-eb52f30a9be3, identifier: EH50837
2025-12-05 20:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 368760c0-bbff-5f09-85f7-35d8a5b02d93 with identifier: SX24290
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2025-12-05 20:00:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 368760c0-bbff-5f09-85f7-35d8a5b02d93 with identifier: SX24290
2025-12-05 20:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 368760c0-bbff-5f09-85f7-35d8a5b02d93 with identifier: SX24290 to the API
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX24290>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 309,
 'expiration_date': '2025-12-06T16:41:37Z',
 'fuel_type': 'hybrid',
 'id': '368760c0-bbff-5f09-85f7-35d8a5b02d93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX24290',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 66882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX24290%27 HTTP/1.1" 200 None
2025-12-05 20:00:52 [auto1.it] INFO: Saving data for SX24290: {'auction_closing_time': 1765039297.0, 'created_time': 1762250901.440023, 'last_price_update_time': 1764964852.905363}
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX24290') HTTP/1.1" 204 0
2025-12-05 20:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8cc8645-0f60-50f8-9c4a-2b7961166855 with identifier: DX87902
2025-12-05 20:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8cc8645-0f60-50f8-9c4a-2b7961166855 with identifier: DX87902
2025-12-05 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b8cc8645-0f60-50f8-9c4a-2b7961166855 spider: auto1.it
2025-12-05 20:00:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: b8cc8645-0f60-50f8-9c4a-2b7961166855 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 144,
 'expiration_date': '2025-12-06T16:30:25Z',
 'fuel_type': 'diesel',
 'id': 'b8cc8645-0f60-50f8-9c4a-2b7961166855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX87902',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 45361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX87902%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Saving data for DX87902: {'auction_closing_time': 1765038625.0, 'created_time': 1764014708.065886, 'last_price_update_time': 1764964853.181805}
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX87902') HTTP/1.1" 204 0
2025-12-05 20:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3084210a-597d-5112-b30c-eb52f30a9be3 with identifier: EH50837
2025-12-05 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3084210a-597d-5112-b30c-eb52f30a9be3 with identifier: EH50837
2025-12-05 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142204 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142204
2025-12-05 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 3084210a-597d-5112-b30c-eb52f30a9be3 spider: auto1.it
2025-12-05 20:00:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3084210a-597d-5112-b30c-eb52f30a9be3 due to rule: high_mileage_for_make.json, error: 142204 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142204
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:06:15Z',
 'fuel_type': 'diesel',
 'id': '3084210a-597d-5112-b30c-eb52f30a9be3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH50837',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 142204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH50837%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Saving data for EH50837: {'auction_closing_time': 1765037175.0, 'created_time': 1762848047.583261, 'last_price_update_time': 1764964853.435201}
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH50837') HTTP/1.1" 204 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: PN13750
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN13750%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for PN13750: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: WA30602
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA30602%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for WA30602: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: TJ68203
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ68203%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for TJ68203: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: PT73799
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT73799%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for PT73799: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: KM02872
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM02872%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for KM02872: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: RX31393
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for RX31393: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: CK36923
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK36923%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for CK36923: 2
2025-12-05 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR02113> (referer: https://www.auto1.com/v1/car-details-view/JR02113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH75264> (referer: https://www.auto1.com/v1/car-details-view/TH75264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: BY02690
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY02690%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for BY02690: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: HK71653
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK71653%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for HK71653: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: WZ62435
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ62435%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for WZ62435: 0
2025-12-05 20:00:53 [auto1.it] INFO: Found listing with ID: ZN73329
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN73329%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [auto1.it] INFO: Scrape type for ZN73329: 0
2025-12-05 20:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM94819> (referer: https://www.auto1.com/v1/car-details-view/YM94819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB13595> (referer: https://www.auto1.com/v1/car-details-view/AB13595/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16eb1730-276c-5a5f-a97e-68a17a5d39f2 with identifier: JR02113
2025-12-05 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2 with scrape type 1
2025-12-05 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_2a1c8340d1e1cc444b6348f48ac56614.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_2a1c8340d1e1cc444b6348f48ac56614.jpg not downloaded yet
2025-12-05 20:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 226639b7-67fa-54b6-969e-1466f5fc1b6c with identifier: TH75264
2025-12-05 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226639b7-67fa-54b6-969e-1466f5fc1b6c with scrape type 2
2025-12-05 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 226639b7-67fa-54b6-969e-1466f5fc1b6c with scrape type 2
2025-12-05 20:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 226639b7-67fa-54b6-969e-1466f5fc1b6c, identifier: TH75264
2025-12-05 20:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 226639b7-67fa-54b6-969e-1466f5fc1b6c with identifier: TH75264
2025-12-05 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 226639b7-67fa-54b6-969e-1466f5fc1b6c with identifier: TH75264
2025-12-05 20:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 226639b7-67fa-54b6-969e-1466f5fc1b6c with identifier: TH75264 to the API
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH75264>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 162,
 'expiration_date': '2025-12-06T16:48:09Z',
 'fuel_type': 'petrol',
 'id': '226639b7-67fa-54b6-969e-1466f5fc1b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH75264',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'MG',
 'model': 'HS',
 'odometer': 24201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG HS 1.5 Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2024}
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH75264%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [auto1.it] INFO: Saving data for TH75264: {'auction_closing_time': 1765039689.0, 'created_time': 1762253141.172186, 'last_price_update_time': 1764964854.292499}
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH75264') HTTP/1.1" 204 0
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_97b91735cc15ccfcd48c7f2fc8ea4ce0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_97b91735cc15ccfcd48c7f2fc8ea4ce0.jpg not downloaded yet
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_0fef22b1523a1e3e6897c857ceeaf413.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_0fef22b1523a1e3e6897c857ceeaf413.jpg not downloaded yet
2025-12-05 20:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819
2025-12-05 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d48b33-6876-5a91-82f3-70aa530b8cc0 with scrape type 1
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 27d48b33-6876-5a91-82f3-70aa530b8cc0
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_60976caa4db2f965df0dbc3831d1c6ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_60976caa4db2f965df0dbc3831d1c6ca.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_9178e7b609b66e9c7894fa514bbe04bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_9178e7b609b66e9c7894fa514bbe04bc.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_998b85bd6037e95e5865961b4380042d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_998b85bd6037e95e5865961b4380042d.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_7b4e79e01bf30317fc0291126d204273.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_7b4e79e01bf30317fc0291126d204273.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_d88f1f57708548c626139236832ceb1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_d88f1f57708548c626139236832ceb1e.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_862de6219544f775d35f26ccfb2ed958.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_862de6219544f775d35f26ccfb2ed958.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_3f85a28f7b77f4a4f07f3fcc070157e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_3f85a28f7b77f4a4f07f3fcc070157e2.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_64342c0b829fd5625a3b9188619a2c0e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_64342c0b829fd5625a3b9188619a2c0e.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_77293cc490175761650757822e5c74c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_77293cc490175761650757822e5c74c0.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_93d125163de6a32af6bbc941c518599c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_93d125163de6a32af6bbc941c518599c.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_40bfbd9fd8d661e04fbe08348507277e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_40bfbd9fd8d661e04fbe08348507277e.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_d130a26d430069939eb7ccaf795ae514.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_d130a26d430069939eb7ccaf795ae514.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_bc4a5a44a18001b956332c740784cc9a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_bc4a5a44a18001b956332c740784cc9a.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_f6db5a8d4150d6caf6569fa3c9683d06.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_f6db5a8d4150d6caf6569fa3c9683d06.jpg already downloaded
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F35%252F6735c2ec6e334fd1ea30120254ee5c55%252Fpa%252FYM94819_e0a6a200874aa433cb39e9a3e754ec68.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_e0a6a200874aa433cb39e9a3e754ec68.jpg already downloaded
2025-12-05 20:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27d48b33-6876-5a91-82f3-70aa530b8cc0, identifier: YM94819
2025-12-05 20:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce5ad424-12d5-5e9a-88bd-b09f224d5c92 with identifier: AB13595
2025-12-05 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5ad424-12d5-5e9a-88bd-b09f224d5c92 with scrape type 2
2025-12-05 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce5ad424-12d5-5e9a-88bd-b09f224d5c92 with scrape type 2
2025-12-05 20:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce5ad424-12d5-5e9a-88bd-b09f224d5c92, identifier: AB13595
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_dfe67dcea6d3a5bec08abc47ca72e14c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dfe67dcea6d3a5bec08abc47ca72e14c.jpg not downloaded yet
2025-12-05 20:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819
2025-12-05 20:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819
2025-12-05 20:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819 to the API
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM94819>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2025-12-06T16:38:26Z',
 'fuel_type': 'petrol',
 'id': '27d48b33-6876-5a91-82f3-70aa530b8cc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM94819',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 130007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_60976caa4db2f965df0dbc3831d1c6ca.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_9178e7b609b66e9c7894fa514bbe04bc.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_998b85bd6037e95e5865961b4380042d.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_7b4e79e01bf30317fc0291126d204273.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_d88f1f57708548c626139236832ceb1e.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_862de6219544f775d35f26ccfb2ed958.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_3f85a28f7b77f4a4f07f3fcc070157e2.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_64342c0b829fd5625a3b9188619a2c0e.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_77293cc490175761650757822e5c74c0.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_93d125163de6a32af6bbc941c518599c.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_40bfbd9fd8d661e04fbe08348507277e.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_d130a26d430069939eb7ccaf795ae514.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_bc4a5a44a18001b956332c740784cc9a.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_f6db5a8d4150d6caf6569fa3c9683d06.jpg',
                'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_e0a6a200874aa433cb39e9a3e754ec68.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_60976caa4db2f965df0dbc3831d1c6ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_9178e7b609b66e9c7894fa514bbe04bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_998b85bd6037e95e5865961b4380042d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_7b4e79e01bf30317fc0291126d204273.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_d88f1f57708548c626139236832ceb1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_862de6219544f775d35f26ccfb2ed958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_3f85a28f7b77f4a4f07f3fcc070157e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_64342c0b829fd5625a3b9188619a2c0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_77293cc490175761650757822e5c74c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_93d125163de6a32af6bbc941c518599c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_40bfbd9fd8d661e04fbe08348507277e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_d130a26d430069939eb7ccaf795ae514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_bc4a5a44a18001b956332c740784cc9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_f6db5a8d4150d6caf6569fa3c9683d06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d48b33-6876-5a91-82f3-70aa530b8cc0/27d48b33-6876-5a91-82f3-70aa530b8cc0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/35/6735c2ec6e334fd1ea30120254ee5c55/pa/YM94819_e0a6a200874aa433cb39e9a3e754ec68.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 35 Shooting Brake AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM94819%27 HTTP/1.1" 200 None
2025-12-05 20:00:55 [auto1.it] INFO: Saving data for YM94819: {'created_time': 1764964855.458802, 'last_price_update_time': 1764964855.458817, 'auction_closing_time': 1765039106.0}
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM94819') HTTP/1.1" 204 0
2025-12-05 20:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce5ad424-12d5-5e9a-88bd-b09f224d5c92 with identifier: AB13595
2025-12-05 20:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce5ad424-12d5-5e9a-88bd-b09f224d5c92 with identifier: AB13595
2025-12-05 20:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce5ad424-12d5-5e9a-88bd-b09f224d5c92 with identifier: AB13595 to the API
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB13595>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 317,
 'expiration_date': '2025-12-06T16:34:21Z',
 'fuel_type': 'hybrid',
 'id': 'ce5ad424-12d5-5e9a-88bd-b09f224d5c92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB13595',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'DR',
 'model': 'DR 6.0',
 'odometer': 40177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 6.0 1.5 Plug-in Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB13595%27 HTTP/1.1" 200 None
2025-12-05 20:00:55 [auto1.it] INFO: Saving data for AB13595: {'auction_closing_time': 1765038861.0, 'created_time': 1762286812.724119, 'last_price_update_time': 1764964855.919429}
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB13595') HTTP/1.1" 204 0
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_f5baf96a39c5fae25a07416f7f92d12b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_f5baf96a39c5fae25a07416f7f92d12b.jpg not downloaded yet
2025-12-05 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ68361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_7455342bcbf1d63477e7888604c2379b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_7455342bcbf1d63477e7888604c2379b.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_825c46593289d3f117fc55fe95be1398.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_825c46593289d3f117fc55fe95be1398.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_de8ed5c066331663718d3fc8541d0931.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_de8ed5c066331663718d3fc8541d0931.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_8f0798ab06f05977c68b7a8f2743aaaf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8f0798ab06f05977c68b7a8f2743aaaf.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_8061e7fc994e7648aa3c806e1b10093c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8061e7fc994e7648aa3c806e1b10093c.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_28f96d63f6d941e52a5905174b34bee6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_28f96d63f6d941e52a5905174b34bee6.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_543c785ccde839b95ea99321b43366b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_543c785ccde839b95ea99321b43366b4.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_dcbb37ef7143b4ff7ba53b5188d659e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dcbb37ef7143b4ff7ba53b5188d659e6.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_e87bd36dbb5dcde5f0632f52a188a7f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e87bd36dbb5dcde5f0632f52a188a7f8.jpg not downloaded yet
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_e754a78e22c2362c0d7880ef878afe49.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e754a78e22c2362c0d7880ef878afe49.jpg not downloaded yet
2025-12-05 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_f5baf96a39c5fae25a07416f7f92d12b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD58389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW19870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03fc950>
2025-12-05 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_f5baf96a39c5fae25a07416f7f92d12b.jpg') HTTP/1.1" 204 0
2025-12-05 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_f5baf96a39c5fae25a07416f7f92d12b.jpg saved to cache
2025-12-05 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e754a78e22c2362c0d7880ef878afe49.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL80680> (referer: https://www.auto1.com/v1/car-details-view/DL80680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW60700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ24707> (referer: https://www.auto1.com/v1/car-details-view/TZ24707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM21448/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR53834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK96914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056e310>
2025-12-05 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_e754a78e22c2362c0d7880ef878afe49.jpg') HTTP/1.1" 204 0
2025-12-05 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e754a78e22c2362c0d7880ef878afe49.jpg saved to cache
2025-12-05 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dcbb37ef7143b4ff7ba53b5188d659e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e87bd36dbb5dcde5f0632f52a188a7f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed56b36-4e14-5011-86cb-1eff8042b43d with identifier: DL80680
2025-12-05 20:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed56b36-4e14-5011-86cb-1eff8042b43d with scrape type 2
2025-12-05 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed56b36-4e14-5011-86cb-1eff8042b43d with scrape type 2
2025-12-05 20:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ed56b36-4e14-5011-86cb-1eff8042b43d, identifier: DL80680
2025-12-05 20:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e06a27-f338-5250-864c-e654a732c3a0 with identifier: TZ24707
2025-12-05 20:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e06a27-f338-5250-864c-e654a732c3a0 with scrape type 2
2025-12-05 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92e06a27-f338-5250-864c-e654a732c3a0 with scrape type 2
2025-12-05 20:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92e06a27-f338-5250-864c-e654a732c3a0, identifier: TZ24707
2025-12-05 20:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ed56b36-4e14-5011-86cb-1eff8042b43d with identifier: DL80680
2025-12-05 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ed56b36-4e14-5011-86cb-1eff8042b43d with identifier: DL80680
2025-12-05 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172758 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172758
2025-12-05 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1ed56b36-4e14-5011-86cb-1eff8042b43d spider: auto1.it
2025-12-05 20:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 1ed56b36-4e14-5011-86cb-1eff8042b43d due to rule: high_mileage_for_country.json, error: 172758 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172758
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:00:17Z',
 'fuel_type': 'diesel',
 'id': '1ed56b36-4e14-5011-86cb-1eff8042b43d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL80680',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 172758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2017}
2025-12-05 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL80680%27 HTTP/1.1" 200 None
2025-12-05 20:00:58 [auto1.it] INFO: Saving data for DL80680: {'auction_closing_time': 1765036817.0, 'created_time': 1764619619.725897, 'last_price_update_time': 1764964858.007641}
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DL80680') HTTP/1.1" 204 0
2025-12-05 20:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92e06a27-f338-5250-864c-e654a732c3a0 with identifier: TZ24707
2025-12-05 20:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92e06a27-f338-5250-864c-e654a732c3a0 with identifier: TZ24707
2025-12-05 20:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92e06a27-f338-5250-864c-e654a732c3a0 with identifier: TZ24707 to the API
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ24707>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-06T16:16:39Z',
 'fuel_type': 'diesel',
 'id': '92e06a27-f338-5250-864c-e654a732c3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ24707',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 84585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Advanced 4Motion',
 'transmission': 'automatic',
 'trim': 'Advanced 4Motion',
 'year': 2020}
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2025-12-05 20:00:58 [auto1.it] INFO: Saving data for TZ24707: {'auction_closing_time': 1765037799.0, 'created_time': 1764316860.004203, 'last_price_update_time': 1764964858.374953}
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ24707') HTTP/1.1" 204 0
2025-12-05 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8061e7fc994e7648aa3c806e1b10093c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_825c46593289d3f117fc55fe95be1398.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_543c785ccde839b95ea99321b43366b4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_de8ed5c066331663718d3fc8541d0931.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8f0798ab06f05977c68b7a8f2743aaaf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ43277/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX17565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0319a90>
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_dcbb37ef7143b4ff7ba53b5188d659e6.jpg') HTTP/1.1" 204 0
2025-12-05 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dcbb37ef7143b4ff7ba53b5188d659e6.jpg saved to cache
2025-12-05 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05314d0>
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_e87bd36dbb5dcde5f0632f52a188a7f8.jpg') HTTP/1.1" 204 0
2025-12-05 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e87bd36dbb5dcde5f0632f52a188a7f8.jpg saved to cache
2025-12-05 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e6310>
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_8061e7fc994e7648aa3c806e1b10093c.jpg') HTTP/1.1" 204 0
2025-12-05 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8061e7fc994e7648aa3c806e1b10093c.jpg saved to cache
2025-12-05 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05da010>
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_825c46593289d3f117fc55fe95be1398.jpg') HTTP/1.1" 204 0
2025-12-05 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_825c46593289d3f117fc55fe95be1398.jpg saved to cache
2025-12-05 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:00:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae041f3d0>
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_543c785ccde839b95ea99321b43366b4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_543c785ccde839b95ea99321b43366b4.jpg saved to cache
2025-12-05 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01a3550>
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_de8ed5c066331663718d3fc8541d0931.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_de8ed5c066331663718d3fc8541d0931.jpg saved to cache
2025-12-05 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f1a50>
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_8f0798ab06f05977c68b7a8f2743aaaf.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8f0798ab06f05977c68b7a8f2743aaaf.jpg saved to cache
2025-12-05 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_0fef22b1523a1e3e6897c857ceeaf413.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_7455342bcbf1d63477e7888604c2379b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dfe67dcea6d3a5bec08abc47ca72e14c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW41289/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK36923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV25208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP59077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ68361> (referer: https://www.auto1.com/v1/car-details-view/NZ68361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_28f96d63f6d941e52a5905174b34bee6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0370350>
2025-12-05 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_0fef22b1523a1e3e6897c857ceeaf413.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_0fef22b1523a1e3e6897c857ceeaf413.jpg saved to cache
2025-12-05 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03edb50>
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_7455342bcbf1d63477e7888604c2379b.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_7455342bcbf1d63477e7888604c2379b.jpg saved to cache
2025-12-05 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0156790>
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_dfe67dcea6d3a5bec08abc47ca72e14c.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dfe67dcea6d3a5bec08abc47ca72e14c.jpg saved to cache
2025-12-05 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_97b91735cc15ccfcd48c7f2fc8ea4ce0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW19870> (referer: https://www.auto1.com/v1/car-details-view/WW19870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c9f2ee8-e2b0-5e20-a645-d660e503bea4 with identifier: NZ68361
2025-12-05 20:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c9f2ee8-e2b0-5e20-a645-d660e503bea4 with scrape type 2
2025-12-05 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c9f2ee8-e2b0-5e20-a645-d660e503bea4 with scrape type 2
2025-12-05 20:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c9f2ee8-e2b0-5e20-a645-d660e503bea4, identifier: NZ68361
2025-12-05 20:01:01 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01cde90>
2025-12-05 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_28f96d63f6d941e52a5905174b34bee6.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_28f96d63f6d941e52a5905174b34bee6.jpg saved to cache
2025-12-05 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c9f2ee8-e2b0-5e20-a645-d660e503bea4 with identifier: NZ68361
2025-12-05 20:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c9f2ee8-e2b0-5e20-a645-d660e503bea4 with identifier: NZ68361
2025-12-05 20:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c9f2ee8-e2b0-5e20-a645-d660e503bea4 with identifier: NZ68361 to the API
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ68361>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:21:39Z',
 'fuel_type': 'petrol',
 'id': '5c9f2ee8-e2b0-5e20-a645-d660e503bea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ68361',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 79774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 T2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2017}
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ68361%27 HTTP/1.1" 200 None
2025-12-05 20:01:02 [auto1.it] INFO: Saving data for NZ68361: {'auction_closing_time': 1765038099.0, 'created_time': 1764014979.965898, 'last_price_update_time': 1764964862.712928}
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NZ68361') HTTP/1.1" 204 0
2025-12-05 20:01:02 [auto1.it] INFO: Found listing with ID: YC62647
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC62647%27 HTTP/1.1" 200 None
2025-12-05 20:01:02 [auto1.it] INFO: Scrape type for YC62647: 2
2025-12-05 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD58389> (referer: https://www.auto1.com/v1/car-details-view/WD58389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:02 [auto1.it] INFO: Found listing with ID: BC61751
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC61751%27 HTTP/1.1" 200 None
2025-12-05 20:01:02 [auto1.it] INFO: Scrape type for BC61751: 0
2025-12-05 20:01:02 [auto1.it] INFO: Found listing with ID: BS05817
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS05817%27 HTTP/1.1" 200 None
2025-12-05 20:01:02 [auto1.it] INFO: Scrape type for BS05817: 0
2025-12-05 20:01:02 [auto1.it] INFO: Found listing with ID: WS74812
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS74812%27 HTTP/1.1" 200 None
2025-12-05 20:01:02 [auto1.it] INFO: Scrape type for WS74812: 2
2025-12-05 20:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae3ac7cd0>
2025-12-05 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_97b91735cc15ccfcd48c7f2fc8ea4ce0.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_97b91735cc15ccfcd48c7f2fc8ea4ce0.jpg saved to cache
2025-12-05 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a7c75a-f24f-56ff-981f-5a2985d51787 with identifier: WW19870
2025-12-05 20:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a7c75a-f24f-56ff-981f-5a2985d51787 with scrape type 2
2025-12-05 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89a7c75a-f24f-56ff-981f-5a2985d51787 with scrape type 2
2025-12-05 20:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89a7c75a-f24f-56ff-981f-5a2985d51787, identifier: WW19870
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: EX29579
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX29579%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for EX29579: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: HE46295
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for HE46295: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: YU19851
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU19851%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for YU19851: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: VU47958
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU47958%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for VU47958: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: XC50328
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50328%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for XC50328: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: WV64596
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV64596%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for WV64596: 2
2025-12-05 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89a7c75a-f24f-56ff-981f-5a2985d51787 with identifier: WW19870
2025-12-05 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89a7c75a-f24f-56ff-981f-5a2985d51787 with identifier: WW19870
2025-12-05 20:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89a7c75a-f24f-56ff-981f-5a2985d51787 with identifier: WW19870 to the API
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW19870>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:57:09Z',
 'fuel_type': 'diesel',
 'id': '89a7c75a-f24f-56ff-981f-5a2985d51787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW19870',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 31723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 35 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19870%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Saving data for WW19870: {'auction_closing_time': 1765040229.0, 'created_time': 1764669746.408212, 'last_price_update_time': 1764964863.729332}
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW19870') HTTP/1.1" 204 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: FF86857
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF86857%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for FF86857: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: MR91682
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR91682%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for MR91682: 2
2025-12-05 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR53834> (referer: https://www.auto1.com/v1/car-details-view/MR53834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX17565> (referer: https://www.auto1.com/v1/car-details-view/XX17565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW60700> (referer: https://www.auto1.com/v1/car-details-view/PW60700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: NY40459
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY40459%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for NY40459: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: GU84869
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU84869%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for GU84869: 2
2025-12-05 20:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5df67ec-53d7-5a38-b082-aa91e2494adb with identifier: WD58389
2025-12-05 20:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5df67ec-53d7-5a38-b082-aa91e2494adb with scrape type 1
2025-12-05 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_7254a4111c78e676bc0bdb789a3391f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_7254a4111c78e676bc0bdb789a3391f9.jpg not downloaded yet
2025-12-05 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK96914> (referer: https://www.auto1.com/v1/car-details-view/UK96914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: UV50835
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV50835%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for UV50835: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: UJ32483
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ32483%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for UJ32483: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: GY37830
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY37830%27 HTTP/1.1" 200 None
2025-12-05 20:01:03 [auto1.it] INFO: Scrape type for GY37830: 0
2025-12-05 20:01:03 [auto1.it] INFO: Found listing with ID: AF72034
2025-12-05 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF72034%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for AF72034: 0
2025-12-05 20:01:04 [auto1.it] INFO: Found listing with ID: FN18507
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN18507%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for FN18507: 0
2025-12-05 20:01:04 [auto1.it] INFO: Found listing with ID: HL50165
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL50165%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for HL50165: 2
2025-12-05 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_2d6007f9fca289938c591f2a43e3470f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_2d6007f9fca289938c591f2a43e3470f.jpg not downloaded yet
2025-12-05 20:01:04 [auto1.it] INFO: Found listing with ID: DC75270
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC75270%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for DC75270: 0
2025-12-05 20:01:04 [auto1.it] INFO: Found listing with ID: MP22831
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP22831%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for MP22831: 2
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_45461ba9baa294a6a29ddc84dfad3176.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_45461ba9baa294a6a29ddc84dfad3176.jpg not downloaded yet
2025-12-05 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM21448> (referer: https://www.auto1.com/v1/car-details-view/CM21448/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU64111> (referer: https://www.auto1.com/v1/car-details-view/UU64111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96db1b1-4361-5db0-be0b-da6261a36ae6 with identifier: MR53834
2025-12-05 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96db1b1-4361-5db0-be0b-da6261a36ae6 with scrape type 2
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96db1b1-4361-5db0-be0b-da6261a36ae6 with scrape type 2
2025-12-05 20:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e96db1b1-4361-5db0-be0b-da6261a36ae6, identifier: MR53834
2025-12-05 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6970a693-4f9a-56f9-a38e-e3074a4e2843 with identifier: XX17565
2025-12-05 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6970a693-4f9a-56f9-a38e-e3074a4e2843 with scrape type 2
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6970a693-4f9a-56f9-a38e-e3074a4e2843 with scrape type 2
2025-12-05 20:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6970a693-4f9a-56f9-a38e-e3074a4e2843, identifier: XX17565
2025-12-05 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81073120-ccfe-56e2-9676-c8832de9e3c4 with identifier: PW60700
2025-12-05 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81073120-ccfe-56e2-9676-c8832de9e3c4 with scrape type 2
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81073120-ccfe-56e2-9676-c8832de9e3c4 with scrape type 2
2025-12-05 20:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 81073120-ccfe-56e2-9676-c8832de9e3c4, identifier: PW60700
2025-12-05 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4bdd16e-2c9c-5000-9ccb-37d01e22912b with identifier: UK96914
2025-12-05 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b with scrape type 1
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_1c917c43fa0f8a5ac57664d529253fbb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_1c917c43fa0f8a5ac57664d529253fbb.jpg not downloaded yet
2025-12-05 20:01:04 [auto1.it] INFO: Found listing with ID: FM62222
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM62222%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for FM62222: 0
2025-12-05 20:01:04 [auto1.it] INFO: Found listing with ID: JM46958
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM46958%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for JM46958: 0
2025-12-05 20:01:04 [auto1.it] INFO: Found listing with ID: LU84839
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU84839%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [auto1.it] INFO: Scrape type for LU84839: 2
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_b862dbb65e8d5fc0a2a08a270ada3d42.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_b862dbb65e8d5fc0a2a08a270ada3d42.jpg not downloaded yet
2025-12-05 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e96db1b1-4361-5db0-be0b-da6261a36ae6 with identifier: MR53834
2025-12-05 20:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e96db1b1-4361-5db0-be0b-da6261a36ae6 with identifier: MR53834
2025-12-05 20:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e96db1b1-4361-5db0-be0b-da6261a36ae6 with identifier: MR53834 to the API
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR53834>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:17:54Z',
 'fuel_type': 'petrol',
 'id': 'e96db1b1-4361-5db0-be0b-da6261a36ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR53834',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 76558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2025-12-05 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR53834%27 HTTP/1.1" 200 None
2025-12-05 20:01:05 [auto1.it] INFO: Saving data for MR53834: {'auction_closing_time': 1765037874.0, 'created_time': 1764878448.104085, 'last_price_update_time': 1764964865.009169}
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR53834') HTTP/1.1" 204 0
2025-12-05 20:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6970a693-4f9a-56f9-a38e-e3074a4e2843 with identifier: XX17565
2025-12-05 20:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6970a693-4f9a-56f9-a38e-e3074a4e2843 with identifier: XX17565
2025-12-05 20:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6970a693-4f9a-56f9-a38e-e3074a4e2843 with identifier: XX17565 to the API
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XX17565>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:30:47Z',
 'fuel_type': 'diesel',
 'id': '6970a693-4f9a-56f9-a38e-e3074a4e2843',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX17565',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 64177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX17565%27 HTTP/1.1" 200 None
2025-12-05 20:01:05 [auto1.it] INFO: Saving data for XX17565: {'auction_closing_time': 1765038647.0, 'created_time': 1763150651.818793, 'last_price_update_time': 1764964865.528238}
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX17565') HTTP/1.1" 204 0
2025-12-05 20:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 81073120-ccfe-56e2-9676-c8832de9e3c4 with identifier: PW60700
2025-12-05 20:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 81073120-ccfe-56e2-9676-c8832de9e3c4 with identifier: PW60700
2025-12-05 20:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 81073120-ccfe-56e2-9676-c8832de9e3c4 with identifier: PW60700 to the API
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PW60700>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 152,
 'expiration_date': '2025-12-06T16:39:50Z',
 'fuel_type': 'diesel',
 'id': '81073120-ccfe-56e2-9676-c8832de9e3c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW60700',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 105738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Xprime 2WD',
 'transmission': 'manual',
 'trim': 'Xprime 2WD',
 'year': 2019}
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW60700%27 HTTP/1.1" 200 None
2025-12-05 20:01:05 [auto1.it] INFO: Saving data for PW60700: {'auction_closing_time': 1765039190.0, 'created_time': 1763150771.608763, 'last_price_update_time': 1764964865.970376}
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW60700') HTTP/1.1" 204 0
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_c332efb6f5a8442ee64810744e8af9da.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_c332efb6f5a8442ee64810744e8af9da.jpg not downloaded yet
2025-12-05 20:01:06 [auto1.it] INFO: Found listing with ID: BT69215
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT69215%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Scrape type for BT69215: 0
2025-12-05 20:01:06 [auto1.it] INFO: Found listing with ID: UL05491
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL05491%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Scrape type for UL05491: 0
2025-12-05 20:01:06 [auto1.it] INFO: Found listing with ID: TW13967
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW13967%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Scrape type for TW13967: 1
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_1b502450a164c356d958d475fa1bd9f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_1b502450a164c356d958d475fa1bd9f4.jpg not downloaded yet
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_34cba89dee48b26e1e361c37c3411518.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_34cba89dee48b26e1e361c37c3411518.jpg not downloaded yet
2025-12-05 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ43277> (referer: https://www.auto1.com/v1/car-details-view/SJ43277/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c1767f-1f86-53b6-a476-487f6c614386 with identifier: CM21448
2025-12-05 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c1767f-1f86-53b6-a476-487f6c614386 with scrape type 1
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_1ce2a217f93c0e0e1e5d66ac215d165b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_1ce2a217f93c0e0e1e5d66ac215d165b.jpg not downloaded yet
2025-12-05 20:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add50671-06c1-5232-aefe-f31877b9518e with identifier: UU64111
2025-12-05 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add50671-06c1-5232-aefe-f31877b9518e with scrape type 2
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add50671-06c1-5232-aefe-f31877b9518e with scrape type 2
2025-12-05 20:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: add50671-06c1-5232-aefe-f31877b9518e, identifier: UU64111
2025-12-05 20:01:06 [auto1.it] INFO: Found listing with ID: FP51001
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP51001%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Scrape type for FP51001: 2
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_f84252e75ad6c54a863a1fff979304aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f84252e75ad6c54a863a1fff979304aa.jpg not downloaded yet
2025-12-05 20:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: add50671-06c1-5232-aefe-f31877b9518e with identifier: UU64111
2025-12-05 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: add50671-06c1-5232-aefe-f31877b9518e with identifier: UU64111
2025-12-05 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2025-12-05 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: add50671-06c1-5232-aefe-f31877b9518e spider: auto1.it
2025-12-05 20:01:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: add50671-06c1-5232-aefe-f31877b9518e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:17:11Z',
 'fuel_type': 'diesel',
 'id': 'add50671-06c1-5232-aefe-f31877b9518e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU64111',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 29557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64111%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Saving data for UU64111: {'auction_closing_time': 1765037831.0, 'created_time': 1763496487.220261, 'last_price_update_time': 1764964866.620677}
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU64111') HTTP/1.1" 204 0
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_95602721a51cd3b82f8dc312d03d7e12.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_95602721a51cd3b82f8dc312d03d7e12.jpg not downloaded yet
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_abf48e36de950e88cb9e62466c8e6736.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_abf48e36de950e88cb9e62466c8e6736.jpg not downloaded yet
2025-12-05 20:01:06 [auto1.it] INFO: Found listing with ID: WU55594
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU55594%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Scrape type for WU55594: 2
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_75103b85a3bb70ed9fd349b7d14235bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_75103b85a3bb70ed9fd349b7d14235bb.jpg not downloaded yet
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_212e7eb6b5adcf9998ca64a297bed772.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_212e7eb6b5adcf9998ca64a297bed772.jpg not downloaded yet
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_bb043243fcbc5420fad821304143f0bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bb043243fcbc5420fad821304143f0bd.jpg not downloaded yet
2025-12-05 20:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf7a4f8-45bc-57c2-ac29-753768d0ca6c with identifier: SJ43277
2025-12-05 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf7a4f8-45bc-57c2-ac29-753768d0ca6c with scrape type 2
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bf7a4f8-45bc-57c2-ac29-753768d0ca6c with scrape type 2
2025-12-05 20:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5bf7a4f8-45bc-57c2-ac29-753768d0ca6c, identifier: SJ43277
2025-12-05 20:01:06 [auto1.it] INFO: Found listing with ID: CV66945
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV66945%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Scrape type for CV66945: 0
2025-12-05 20:01:06 [auto1.it] INFO: Found listing with ID: LP33794
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP33794%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [auto1.it] INFO: Scrape type for LP33794: 1
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_96316f29ae69a986001c634b61e1dcb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_96316f29ae69a986001c634b61e1dcb2.jpg not downloaded yet
2025-12-05 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5bf7a4f8-45bc-57c2-ac29-753768d0ca6c with identifier: SJ43277
2025-12-05 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5bf7a4f8-45bc-57c2-ac29-753768d0ca6c with identifier: SJ43277
2025-12-05 20:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5bf7a4f8-45bc-57c2-ac29-753768d0ca6c with identifier: SJ43277 to the API
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ43277>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:54:35Z',
 'fuel_type': 'petrol',
 'id': '5bf7a4f8-45bc-57c2-ac29-753768d0ca6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ43277',
 'listing': 'auction',
 'location': 'Garbagnate Milanese',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 71315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ43277%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Saving data for SJ43277: {'auction_closing_time': 1765040075.0, 'created_time': 1764756190.852359, 'last_price_update_time': 1764964867.330666}
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ43277') HTTP/1.1" 204 0
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_5e202dee931150f228bf237cea83511b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_5e202dee931150f228bf237cea83511b.jpg not downloaded yet
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_bc4060ee72cb13da8b446291c80079d8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bc4060ee72cb13da8b446291c80079d8.jpg not downloaded yet
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: MV61380
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV61380%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for MV61380: 0
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: FJ07347
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ07347%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for FJ07347: 1
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_d357fcf81afb6697bf79fe9875e9fa16.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_d357fcf81afb6697bf79fe9875e9fa16.jpg not downloaded yet
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP29933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX45819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH65548/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_9412db46fc5598258b2b7e288ac543d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_9412db46fc5598258b2b7e288ac543d5.jpg not downloaded yet
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_10dac1bb29bc2694d46c4d394c022193.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_10dac1bb29bc2694d46c4d394c022193.jpg not downloaded yet
2025-12-05 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU76780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU11747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: MX11198
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for MX11198: 0
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: EW36675
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for EW36675: 0
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: AJ19818
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ19818%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for AJ19818: 1
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_fdf48758a5581394825c1b0ac80c5bbe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fdf48758a5581394825c1b0ac80c5bbe.jpg not downloaded yet
2025-12-05 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_e3f088963a0b0fdce1bb5acf44865c03.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e3f088963a0b0fdce1bb5acf44865c03.jpg not downloaded yet
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_88d200cf749dc10c0a9cdd311bff97cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88d200cf749dc10c0a9cdd311bff97cc.jpg not downloaded yet
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: KZ32796
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ32796%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for KZ32796: 0
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: BY71307
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY71307%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for BY71307: 2
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_bf2708ada3d4d6f36272d53ae1d58183.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_bf2708ada3d4d6f36272d53ae1d58183.jpg not downloaded yet
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_e909125cfb6113cabfaffdb4f17079cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e909125cfb6113cabfaffdb4f17079cb.jpg not downloaded yet
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_dbfad8128015de917c8ba692a475f18a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_dbfad8128015de917c8ba692a475f18a.jpg not downloaded yet
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF89394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_2a1c8340d1e1cc444b6348f48ac56614.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:07 [auto1.it] INFO: Found listing with ID: RT08597
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT08597%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [auto1.it] INFO: Scrape type for RT08597: 2
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_f8bd7fe750bdab2e0df4cc4a9d1dc4d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f8bd7fe750bdab2e0df4cc4a9d1dc4d0.jpg not downloaded yet
2025-12-05 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_5e202dee931150f228bf237cea83511b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_830a2f05faeb25968b725373faf39ff8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_830a2f05faeb25968b725373faf39ff8.jpg not downloaded yet
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_76a68bd067132608fe251b88709eca72.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_76a68bd067132608fe251b88709eca72.jpg not downloaded yet
2025-12-05 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_e003b6de31abadc491675b5a9221b8bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_e003b6de31abadc491675b5a9221b8bb.jpg not downloaded yet
2025-12-05 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bc4060ee72cb13da8b446291c80079d8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_66f8c273edcbed0fbddd4cc60846218d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_66f8c273edcbed0fbddd4cc60846218d.jpg not downloaded yet
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_4c62276a2625201dc775fc5c4435d4bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4c62276a2625201dc775fc5c4435d4bc.jpg not downloaded yet
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_453843e1abf7afa7079c2b98337db9cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_453843e1abf7afa7079c2b98337db9cb.jpg not downloaded yet
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_b73cfacb2202ecca64a49b0a48503f7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_b73cfacb2202ecca64a49b0a48503f7c.jpg not downloaded yet
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_ac05c82d774e9285aa13cbca481c7ba4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_ac05c82d774e9285aa13cbca481c7ba4.jpg not downloaded yet
2025-12-05 20:01:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0068490>
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F01%252F4e010245fb40ff35a1cdaa2355c48aea%252Fpa%252FJR02113_2a1c8340d1e1cc444b6348f48ac56614.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_2a1c8340d1e1cc444b6348f48ac56614.jpg saved to cache
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2
2025-12-05 20:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16eb1730-276c-5a5f-a97e-68a17a5d39f2, skipping ID generation
2025-12-05 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2 with scrape type 1
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 16eb1730-276c-5a5f-a97e-68a17a5d39f2 from tracking dictionaries
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16eb1730-276c-5a5f-a97e-68a17a5d39f2 sending to next pipeline
2025-12-05 20:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16eb1730-276c-5a5f-a97e-68a17a5d39f2, identifier: JR02113
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_fae0dbc956bf7ac411fc74a73c0a4e44.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fae0dbc956bf7ac411fc74a73c0a4e44.jpg not downloaded yet
2025-12-05 20:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16eb1730-276c-5a5f-a97e-68a17a5d39f2 with identifier: JR02113
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2025-12-05 20:01:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16eb1730-276c-5a5f-a97e-68a17a5d39f2 with identifier: JR02113
2025-12-05 20:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16eb1730-276c-5a5f-a97e-68a17a5d39f2 with identifier: JR02113 to the API
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_2a1c8340d1e1cc444b6348f48ac56614.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:59:44Z',
 'fuel_type': 'hybrid',
 'id': '16eb1730-276c-5a5f-a97e-68a17a5d39f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR02113',
 'listing': 'auction',
 'location': 'IT, Pontedassio',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 36941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2532645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_2a1c8340d1e1cc444b6348f48ac56614.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_97b91735cc15ccfcd48c7f2fc8ea4ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_0fef22b1523a1e3e6897c857ceeaf413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dfe67dcea6d3a5bec08abc47ca72e14c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_f5baf96a39c5fae25a07416f7f92d12b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_7455342bcbf1d63477e7888604c2379b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_825c46593289d3f117fc55fe95be1398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_de8ed5c066331663718d3fc8541d0931.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8f0798ab06f05977c68b7a8f2743aaaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_8061e7fc994e7648aa3c806e1b10093c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_28f96d63f6d941e52a5905174b34bee6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2915571,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_543c785ccde839b95ea99321b43366b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_dcbb37ef7143b4ff7ba53b5188d659e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e87bd36dbb5dcde5f0632f52a188a7f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eb1730-276c-5a5f-a97e-68a17a5d39f2/16eb1730-276c-5a5f-a97e-68a17a5d39f2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/01/4e010245fb40ff35a1cdaa2355c48aea/pa/JR02113_e754a78e22c2362c0d7880ef878afe49.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Exellence 2WD',
 'transmission': 'automatic',
 'trim': 'Exellence 2WD',
 'year': 2023}
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02113%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [auto1.it] INFO: Saving data for JR02113: {'created_time': 1764964869.300078, 'last_price_update_time': 1764964869.300089, 'auction_closing_time': 1765040384.0}
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR02113') HTTP/1.1" 204 0
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0634c90>
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_5e202dee931150f228bf237cea83511b.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_5e202dee931150f228bf237cea83511b.jpg saved to cache
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_7343c771e85b0f85f7f3b7f4bfbed0d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_7343c771e85b0f85f7f3b7f4bfbed0d3.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_4407c0add6abbac8ea822a9732d38039.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4407c0add6abbac8ea822a9732d38039.jpg not downloaded yet
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0080110>
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_bc4060ee72cb13da8b446291c80079d8.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bc4060ee72cb13da8b446291c80079d8.jpg saved to cache
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_96316f29ae69a986001c634b61e1dcb2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC62647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR91682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV64596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS74812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_a534ee504bf83144192d401bf85a82c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_a534ee504bf83144192d401bf85a82c3.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_88f9fd6bed25ff976efc7d049e845653.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88f9fd6bed25ff976efc7d049e845653.jpg not downloaded yet
2025-12-05 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED77017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_8dc7cd1aa3c07ef84d5119529aea9dd3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_8dc7cd1aa3c07ef84d5119529aea9dd3.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_6d729488237ec099637b4b0efe592c0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_6d729488237ec099637b4b0efe592c0a.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_06b6bb2a7d07124ae16aac3cde853160.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_06b6bb2a7d07124ae16aac3cde853160.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_25f3c98a1a5623603fc0415b7c9604d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_25f3c98a1a5623603fc0415b7c9604d2.jpg not downloaded yet
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_7343c771e85b0f85f7f3b7f4bfbed0d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007a1d0>
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_96316f29ae69a986001c634b61e1dcb2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_96316f29ae69a986001c634b61e1dcb2.jpg saved to cache
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fae0dbc956bf7ac411fc74a73c0a4e44.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0163110>
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_7343c771e85b0f85f7f3b7f4bfbed0d3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_7343c771e85b0f85f7f3b7f4bfbed0d3.jpg saved to cache
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_ac05c82d774e9285aa13cbca481c7ba4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88f9fd6bed25ff976efc7d049e845653.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH65548> (referer: https://www.auto1.com/v1/car-details-view/EH65548/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX45819> (referer: https://www.auto1.com/v1/car-details-view/RX45819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae2832c90>
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_fae0dbc956bf7ac411fc74a73c0a4e44.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fae0dbc956bf7ac411fc74a73c0a4e44.jpg saved to cache
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_7254a4111c78e676bc0bdb789a3391f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_45461ba9baa294a6a29ddc84dfad3176.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01907d0>
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_ac05c82d774e9285aa13cbca481c7ba4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_ac05c82d774e9285aa13cbca481c7ba4.jpg saved to cache
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05660d0>
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_88f9fd6bed25ff976efc7d049e845653.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88f9fd6bed25ff976efc7d049e845653.jpg saved to cache
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a2b31ab-f37a-5684-963c-65b26fe4d4f2 with identifier: EH65548
2025-12-05 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a2b31ab-f37a-5684-963c-65b26fe4d4f2 with scrape type 1
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 9a2b31ab-f37a-5684-963c-65b26fe4d4f2
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_be750a78c26a6bd61fa468d984fc1552.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_be750a78c26a6bd61fa468d984fc1552.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_11158504d4cf2cdca5d1b0cde119e802.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_11158504d4cf2cdca5d1b0cde119e802.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_424462d85818854b801c1ab393f03458.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_424462d85818854b801c1ab393f03458.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_dba34dd94fb190866f48e022641bd52f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_dba34dd94fb190866f48e022641bd52f.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_006e1de24cedc30126d0740c47fa2c14.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_006e1de24cedc30126d0740c47fa2c14.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_ae4b29da937746b93534d16f97e207ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_ae4b29da937746b93534d16f97e207ad.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_4531b0fdc64a39a2c454c09884f6f318.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_4531b0fdc64a39a2c454c09884f6f318.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_99541203e19a45efe69c9da3ec7a54cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_99541203e19a45efe69c9da3ec7a54cd.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_0d6adc399770dbaa2842dbcec6ee290f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_0d6adc399770dbaa2842dbcec6ee290f.jpg already downloaded
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_506aa281347fbc3b04447dec6eb6f5bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_506aa281347fbc3b04447dec6eb6f5bc.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_9e5ed09f6664148efd9b7affc24cdd23.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_9e5ed09f6664148efd9b7affc24cdd23.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_5d7a1f5b6bfa33938ad674f4edf303e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_5d7a1f5b6bfa33938ad674f4edf303e8.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_c5d46c5f82aeb3ba7c246ee648ef0086.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_c5d46c5f82aeb3ba7c246ee648ef0086.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_f98517d3416f852df908bb517a04c7ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_f98517d3416f852df908bb517a04c7ae.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe6%252Fb2e6d82942ad2f9e0901aee70ed85e36%252Fpa%252FEH65548_4218e805a9a57c53587c744a795ddf3e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_4218e805a9a57c53587c744a795ddf3e.jpg already downloaded
2025-12-05 20:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a2b31ab-f37a-5684-963c-65b26fe4d4f2, identifier: EH65548
2025-12-05 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdff1daf-fc38-59d0-8371-7034356c0e7d with identifier: RX45819
2025-12-05 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdff1daf-fc38-59d0-8371-7034356c0e7d with scrape type 1
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item cdff1daf-fc38-59d0-8371-7034356c0e7d
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_39c3bf8e07e748446c11a8a92fbdcf66.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_39c3bf8e07e748446c11a8a92fbdcf66.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_16a3215a93026ca131a95561cdbc9fe4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_16a3215a93026ca131a95561cdbc9fe4.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_2cc4127e439b51436e1c881716dbdbe1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_2cc4127e439b51436e1c881716dbdbe1.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_7e2e1b9f87339ad196fe1c00b9ec0755.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_7e2e1b9f87339ad196fe1c00b9ec0755.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_c5938507dc5cb92fbe6f8c16b3729356.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_c5938507dc5cb92fbe6f8c16b3729356.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_caddd04896b424eef860937cb52175f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_caddd04896b424eef860937cb52175f4.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_58db4ce57098c76ca5c233ffb8bd200f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_58db4ce57098c76ca5c233ffb8bd200f.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_b60f7b66dd9939c0887ec4e88fff0917.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_b60f7b66dd9939c0887ec4e88fff0917.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_4c6423696eb902bbc20dcb50c5276b1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_4c6423696eb902bbc20dcb50c5276b1f.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_b44ffa42ae04800cc3f8587799bde3bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_b44ffa42ae04800cc3f8587799bde3bb.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_820fed27f993055a382487e140346aa8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_820fed27f993055a382487e140346aa8.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_702d702a82785b410180de055aaf1441.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_702d702a82785b410180de055aaf1441.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_7e519f3678192f40f33aa9efdca0cc45.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_7e519f3678192f40f33aa9efdca0cc45.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_ffcf05e4e4fdb8604a821cac04ef5d0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_ffcf05e4e4fdb8604a821cac04ef5d0f.jpg already downloaded
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fa6%252Fa7a629e4e0780651916bdb8c7b6cd02a%252Fpa%252FRX45819_3a620e9ba444650bfe713cff9d96e693.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_3a620e9ba444650bfe713cff9d96e693.jpg already downloaded
2025-12-05 20:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cdff1daf-fc38-59d0-8371-7034356c0e7d, identifier: RX45819
2025-12-05 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a2b31ab-f37a-5684-963c-65b26fe4d4f2 with identifier: EH65548
2025-12-05 20:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a2b31ab-f37a-5684-963c-65b26fe4d4f2 with identifier: EH65548
2025-12-05 20:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a2b31ab-f37a-5684-963c-65b26fe4d4f2 with identifier: EH65548 to the API
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH65548>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 114,
 'expiration_date': '2025-12-06T16:37:36Z',
 'fuel_type': 'gas',
 'id': '9a2b31ab-f37a-5684-963c-65b26fe4d4f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH65548',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'DR',
 'model': 'DR 3.0',
 'odometer': 24842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_be750a78c26a6bd61fa468d984fc1552.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_11158504d4cf2cdca5d1b0cde119e802.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_424462d85818854b801c1ab393f03458.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_dba34dd94fb190866f48e022641bd52f.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_006e1de24cedc30126d0740c47fa2c14.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_ae4b29da937746b93534d16f97e207ad.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_4531b0fdc64a39a2c454c09884f6f318.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_99541203e19a45efe69c9da3ec7a54cd.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_0d6adc399770dbaa2842dbcec6ee290f.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_506aa281347fbc3b04447dec6eb6f5bc.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_9e5ed09f6664148efd9b7affc24cdd23.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_5d7a1f5b6bfa33938ad674f4edf303e8.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_c5d46c5f82aeb3ba7c246ee648ef0086.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_f98517d3416f852df908bb517a04c7ae.jpg',
                'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_4218e805a9a57c53587c744a795ddf3e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_be750a78c26a6bd61fa468d984fc1552.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_11158504d4cf2cdca5d1b0cde119e802.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_424462d85818854b801c1ab393f03458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_dba34dd94fb190866f48e022641bd52f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_006e1de24cedc30126d0740c47fa2c14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_ae4b29da937746b93534d16f97e207ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325517,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_4531b0fdc64a39a2c454c09884f6f318.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2316845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_99541203e19a45efe69c9da3ec7a54cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_0d6adc399770dbaa2842dbcec6ee290f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_506aa281347fbc3b04447dec6eb6f5bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_9e5ed09f6664148efd9b7affc24cdd23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2389364,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_5d7a1f5b6bfa33938ad674f4edf303e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_c5d46c5f82aeb3ba7c246ee648ef0086.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2259869,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_f98517d3416f852df908bb517a04c7ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a2b31ab-f37a-5684-963c-65b26fe4d4f2/9a2b31ab-f37a-5684-963c-65b26fe4d4f2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e6/b2e6d82942ad2f9e0901aee70ed85e36/pa/EH65548_4218e805a9a57c53587c744a795ddf3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 3.0 1.5 LPG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH65548%27 HTTP/1.1" 200 None
2025-12-05 20:01:13 [auto1.it] INFO: Saving data for EH65548: {'created_time': 1764964873.108105, 'last_price_update_time': 1764964873.108115, 'auction_closing_time': 1765039056.0}
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH65548') HTTP/1.1" 204 0
2025-12-05 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cdff1daf-fc38-59d0-8371-7034356c0e7d with identifier: RX45819
2025-12-05 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cdff1daf-fc38-59d0-8371-7034356c0e7d with identifier: RX45819
2025-12-05 20:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cdff1daf-fc38-59d0-8371-7034356c0e7d with identifier: RX45819 to the API
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX45819>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2025-12-06T16:57:32Z',
 'fuel_type': 'diesel',
 'id': 'cdff1daf-fc38-59d0-8371-7034356c0e7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX45819',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 118591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_39c3bf8e07e748446c11a8a92fbdcf66.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_16a3215a93026ca131a95561cdbc9fe4.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_2cc4127e439b51436e1c881716dbdbe1.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_7e2e1b9f87339ad196fe1c00b9ec0755.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_c5938507dc5cb92fbe6f8c16b3729356.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_caddd04896b424eef860937cb52175f4.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_58db4ce57098c76ca5c233ffb8bd200f.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_b60f7b66dd9939c0887ec4e88fff0917.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_4c6423696eb902bbc20dcb50c5276b1f.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_b44ffa42ae04800cc3f8587799bde3bb.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_820fed27f993055a382487e140346aa8.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_702d702a82785b410180de055aaf1441.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_7e519f3678192f40f33aa9efdca0cc45.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_ffcf05e4e4fdb8604a821cac04ef5d0f.jpg',
                'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_3a620e9ba444650bfe713cff9d96e693.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_39c3bf8e07e748446c11a8a92fbdcf66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_16a3215a93026ca131a95561cdbc9fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_2cc4127e439b51436e1c881716dbdbe1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_7e2e1b9f87339ad196fe1c00b9ec0755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_c5938507dc5cb92fbe6f8c16b3729356.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_caddd04896b424eef860937cb52175f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_58db4ce57098c76ca5c233ffb8bd200f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_b60f7b66dd9939c0887ec4e88fff0917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_4c6423696eb902bbc20dcb50c5276b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_b44ffa42ae04800cc3f8587799bde3bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_820fed27f993055a382487e140346aa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_702d702a82785b410180de055aaf1441.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_7e519f3678192f40f33aa9efdca0cc45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_ffcf05e4e4fdb8604a821cac04ef5d0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdff1daf-fc38-59d0-8371-7034356c0e7d/cdff1daf-fc38-59d0-8371-7034356c0e7d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/a6/a7a629e4e0780651916bdb8c7b6cd02a/pa/RX45819_3a620e9ba444650bfe713cff9d96e693.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 Business AWD',
 'transmission': 'automatic',
 'trim': 'Business AWD',
 'year': 2018}
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX45819%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [auto1.it] INFO: Saving data for RX45819: {'created_time': 1764964874.425625, 'last_price_update_time': 1764964874.425636, 'auction_closing_time': 1765040252.0}
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX45819') HTTP/1.1" 204 0
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_06b6bb2a7d07124ae16aac3cde853160.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_1b502450a164c356d958d475fa1bd9f4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS74812> (referer: https://www.auto1.com/v1/car-details-view/WS74812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ07347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP29933> (referer: https://www.auto1.com/v1/car-details-view/HP29933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF89394> (referer: https://www.auto1.com/v1/car-details-view/WF89394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU11747> (referer: https://www.auto1.com/v1/car-details-view/VU11747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0222550>
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_7254a4111c78e676bc0bdb789a3391f9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_7254a4111c78e676bc0bdb789a3391f9.jpg saved to cache
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01d7450>
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_45461ba9baa294a6a29ddc84dfad3176.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_45461ba9baa294a6a29ddc84dfad3176.jpg saved to cache
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_2d6007f9fca289938c591f2a43e3470f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae005aa50>
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_06b6bb2a7d07124ae16aac3cde853160.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_06b6bb2a7d07124ae16aac3cde853160.jpg saved to cache
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae009cfd0>
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_1b502450a164c356d958d475fa1bd9f4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_1b502450a164c356d958d475fa1bd9f4.jpg saved to cache
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879cf23c-7748-5fb5-9ad0-8f469125b749 with identifier: WS74812
2025-12-05 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879cf23c-7748-5fb5-9ad0-8f469125b749 with scrape type 2
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 879cf23c-7748-5fb5-9ad0-8f469125b749 with scrape type 2
2025-12-05 20:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 879cf23c-7748-5fb5-9ad0-8f469125b749, identifier: WS74812
2025-12-05 20:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 with identifier: HP29933
2025-12-05 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 with scrape type 1
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_7c95f753a0715dd212bbe1bbae9a71d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7c95f753a0715dd212bbe1bbae9a71d7.jpg not downloaded yet
2025-12-05 20:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99bbf3d-ba29-5b01-91ef-618cc3af0e2b with identifier: WF89394
2025-12-05 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99bbf3d-ba29-5b01-91ef-618cc3af0e2b with scrape type 2
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c99bbf3d-ba29-5b01-91ef-618cc3af0e2b with scrape type 2
2025-12-05 20:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c99bbf3d-ba29-5b01-91ef-618cc3af0e2b, identifier: WF89394
2025-12-05 20:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 082a89d7-60d2-59d9-8bb7-3a29b93f1ed2 with identifier: VU11747
2025-12-05 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 082a89d7-60d2-59d9-8bb7-3a29b93f1ed2 with scrape type 2
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 082a89d7-60d2-59d9-8bb7-3a29b93f1ed2 with scrape type 2
2025-12-05 20:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 082a89d7-60d2-59d9-8bb7-3a29b93f1ed2, identifier: VU11747
2025-12-05 20:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 879cf23c-7748-5fb5-9ad0-8f469125b749 with identifier: WS74812
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2025-12-05 20:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 879cf23c-7748-5fb5-9ad0-8f469125b749 with identifier: WS74812
2025-12-05 20:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 879cf23c-7748-5fb5-9ad0-8f469125b749 with identifier: WS74812 to the API
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS74812>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:07:18Z',
 'fuel_type': 'petrol',
 'id': '879cf23c-7748-5fb5-9ad0-8f469125b749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS74812',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 57988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS74812%27 HTTP/1.1" 200 None
2025-12-05 20:01:17 [auto1.it] INFO: Saving data for WS74812: {'auction_closing_time': 1765037238.0, 'created_time': 1763496172.749399, 'last_price_update_time': 1764964877.194061}
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WS74812') HTTP/1.1" 204 0
2025-12-05 20:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c99bbf3d-ba29-5b01-91ef-618cc3af0e2b with identifier: WF89394
2025-12-05 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c99bbf3d-ba29-5b01-91ef-618cc3af0e2b with identifier: WF89394
2025-12-05 20:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c99bbf3d-ba29-5b01-91ef-618cc3af0e2b with identifier: WF89394 to the API
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WF89394>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:04:11Z',
 'fuel_type': 'petrol',
 'id': 'c99bbf3d-ba29-5b01-91ef-618cc3af0e2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF89394',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 73121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF89394%27 HTTP/1.1" 200 None
2025-12-05 20:01:17 [auto1.it] INFO: Saving data for WF89394: {'auction_closing_time': 1765037051.0, 'created_time': 1762250636.380436, 'last_price_update_time': 1764964877.577246}
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WF89394') HTTP/1.1" 204 0
2025-12-05 20:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 082a89d7-60d2-59d9-8bb7-3a29b93f1ed2 with identifier: VU11747
2025-12-05 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 082a89d7-60d2-59d9-8bb7-3a29b93f1ed2 with identifier: VU11747
2025-12-05 20:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 082a89d7-60d2-59d9-8bb7-3a29b93f1ed2 with identifier: VU11747 to the API
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU11747>
{'auction_title': '',
 'c_o_2_emission_value': 51,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2025-12-06T16:50:32Z',
 'fuel_type': 'hybrid',
 'id': '082a89d7-60d2-59d9-8bb7-3a29b93f1ed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU11747',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 51763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2019}
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11747%27 HTTP/1.1" 200 None
2025-12-05 20:01:17 [auto1.it] INFO: Saving data for VU11747: {'auction_closing_time': 1765039832.0, 'created_time': 1764669717.775052, 'last_price_update_time': 1764964877.944823}
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU11747') HTTP/1.1" 204 0
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_487cb3200c6518f3054e7c435d130c0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_487cb3200c6518f3054e7c435d130c0f.jpg not downloaded yet
2025-12-05 20:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV64596> (referer: https://www.auto1.com/v1/car-details-view/WV64596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR91682> (referer: https://www.auto1.com/v1/car-details-view/MR91682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_3c44781317eee147ed3d854ef6e03555.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_3c44781317eee147ed3d854ef6e03555.jpg not downloaded yet
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED77017> (referer: https://www.auto1.com/v1/car-details-view/ED77017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae043ecd0>
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_2d6007f9fca289938c591f2a43e3470f.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_2d6007f9fca289938c591f2a43e3470f.jpg saved to cache
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_a534ee504bf83144192d401bf85a82c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_25f3c98a1a5623603fc0415b7c9604d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_73c631a9d6b8fdab7c55f9c3b5761f2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_73c631a9d6b8fdab7c55f9c3b5761f2f.jpg not downloaded yet
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_8dc7cd1aa3c07ef84d5119529aea9dd3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7c95f753a0715dd212bbe1bbae9a71d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_b73cfacb2202ecca64a49b0a48503f7c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_d357fcf81afb6697bf79fe9875e9fa16.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_2c45cdd382e8b3cffd7d3dbdf14634cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_2c45cdd382e8b3cffd7d3dbdf14634cd.jpg not downloaded yet
2025-12-05 20:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc16878-aa0b-5947-94b3-65af70c2c2aa with identifier: WV64596
2025-12-05 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc16878-aa0b-5947-94b3-65af70c2c2aa with scrape type 2
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc16878-aa0b-5947-94b3-65af70c2c2aa with scrape type 2
2025-12-05 20:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3cc16878-aa0b-5947-94b3-65af70c2c2aa, identifier: WV64596
2025-12-05 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00f355c5-0111-5936-a49e-db94e358a724 with identifier: MR91682
2025-12-05 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f355c5-0111-5936-a49e-db94e358a724 with scrape type 2
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00f355c5-0111-5936-a49e-db94e358a724 with scrape type 2
2025-12-05 20:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00f355c5-0111-5936-a49e-db94e358a724, identifier: MR91682
2025-12-05 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 696453b0-7129-549e-bbc6-a8ac117a4952 with identifier: ED77017
2025-12-05 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 696453b0-7129-549e-bbc6-a8ac117a4952 with scrape type 2
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 696453b0-7129-549e-bbc6-a8ac117a4952 with scrape type 2
2025-12-05 20:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 696453b0-7129-549e-bbc6-a8ac117a4952, identifier: ED77017
2025-12-05 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3cc16878-aa0b-5947-94b3-65af70c2c2aa with identifier: WV64596
2025-12-05 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3cc16878-aa0b-5947-94b3-65af70c2c2aa with identifier: WV64596
2025-12-05 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186936 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186936
2025-12-05 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3cc16878-aa0b-5947-94b3-65af70c2c2aa spider: auto1.it
2025-12-05 20:01:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3cc16878-aa0b-5947-94b3-65af70c2c2aa due to rule: high_mileage_for_country.json, error: 186936 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186936
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2025-12-06T16:59:52Z',
 'fuel_type': 'diesel',
 'id': '3cc16878-aa0b-5947-94b3-65af70c2c2aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV64596',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 186936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2018}
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV64596%27 HTTP/1.1" 200 None
2025-12-05 20:01:19 [auto1.it] INFO: Saving data for WV64596: {'auction_closing_time': 1765040392.0, 'created_time': 1763496199.945784, 'last_price_update_time': 1764964879.222141}
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV64596') HTTP/1.1" 204 0
2025-12-05 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00f355c5-0111-5936-a49e-db94e358a724 with identifier: MR91682
2025-12-05 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00f355c5-0111-5936-a49e-db94e358a724 with identifier: MR91682
2025-12-05 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 00f355c5-0111-5936-a49e-db94e358a724 with identifier: MR91682 to the API
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR91682>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:44:04Z',
 'fuel_type': 'petrol',
 'id': '00f355c5-0111-5936-a49e-db94e358a724',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR91682',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 33413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2020}
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR91682%27 HTTP/1.1" 200 None
2025-12-05 20:01:19 [auto1.it] INFO: Saving data for MR91682: {'auction_closing_time': 1765039444.0, 'created_time': 1763582518.293306, 'last_price_update_time': 1764964879.691946}
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR91682') HTTP/1.1" 204 0
2025-12-05 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 696453b0-7129-549e-bbc6-a8ac117a4952 with identifier: ED77017
2025-12-05 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 696453b0-7129-549e-bbc6-a8ac117a4952 with identifier: ED77017
2025-12-05 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 696453b0-7129-549e-bbc6-a8ac117a4952 with identifier: ED77017 to the API
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED77017>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:04:39Z',
 'fuel_type': 'diesel',
 'id': '696453b0-7129-549e-bbc6-a8ac117a4952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED77017',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 76200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic',
 'transmission': 'automatic',
 'trim': 'R-Dynamic',
 'year': 2021}
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED77017%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [auto1.it] INFO: Saving data for ED77017: {'auction_closing_time': 1765037079.0, 'created_time': 1761127248.799382, 'last_price_update_time': 1764964880.119038}
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED77017') HTTP/1.1" 204 0
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_33a5a1a8e91ac911c3167f87ef7622a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_33a5a1a8e91ac911c3167f87ef7622a5.jpg not downloaded yet
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_e003b6de31abadc491675b5a9221b8bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_66f8c273edcbed0fbddd4cc60846218d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_487cb3200c6518f3054e7c435d130c0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_bf426924dd60ef8a9b0cec73427d2e54.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bf426924dd60ef8a9b0cec73427d2e54.jpg not downloaded yet
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0377e10>
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_a534ee504bf83144192d401bf85a82c3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_a534ee504bf83144192d401bf85a82c3.jpg saved to cache
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0394d50>
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_25f3c98a1a5623603fc0415b7c9604d2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_25f3c98a1a5623603fc0415b7c9604d2.jpg saved to cache
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0635090>
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_8dc7cd1aa3c07ef84d5119529aea9dd3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_8dc7cd1aa3c07ef84d5119529aea9dd3.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae018bc90>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_7c95f753a0715dd212bbe1bbae9a71d7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7c95f753a0715dd212bbe1bbae9a71d7.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae24e7790>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_b73cfacb2202ecca64a49b0a48503f7c.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_b73cfacb2202ecca64a49b0a48503f7c.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0267050>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_d357fcf81afb6697bf79fe9875e9fa16.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_d357fcf81afb6697bf79fe9875e9fa16.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4407c0add6abbac8ea822a9732d38039.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_46d79bd5f675249e95b845d4973ca698.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_46d79bd5f675249e95b845d4973ca698.jpg not downloaded yet
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ07347> (referer: https://www.auto1.com/v1/car-details-view/FJ07347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC62647> (referer: https://www.auto1.com/v1/car-details-view/YC62647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU76780> (referer: https://www.auto1.com/v1/car-details-view/GU76780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01862d0>
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_e003b6de31abadc491675b5a9221b8bb.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_e003b6de31abadc491675b5a9221b8bb.jpg saved to cache
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0512350>
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_66f8c273edcbed0fbddd4cc60846218d.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_66f8c273edcbed0fbddd4cc60846218d.jpg saved to cache
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0265750>
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_487cb3200c6518f3054e7c435d130c0f.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_487cb3200c6518f3054e7c435d130c0f.jpg saved to cache
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_7158f4749a79a9137e263c4328c82e75.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7158f4749a79a9137e263c4328c82e75.jpg not downloaded yet
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_73c631a9d6b8fdab7c55f9c3b5761f2f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_830a2f05faeb25968b725373faf39ff8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT08597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_9daeaa08549dd809cfdbf1cedf759097.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_9daeaa08549dd809cfdbf1cedf759097.jpg not downloaded yet
2025-12-05 20:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0372b10>
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_4407c0add6abbac8ea822a9732d38039.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4407c0add6abbac8ea822a9732d38039.jpg saved to cache
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e879e6-56d0-56bb-a0e6-5334db808eee with identifier: FJ07347
2025-12-05 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e879e6-56d0-56bb-a0e6-5334db808eee with scrape type 1
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_f27c4cf98441b41d3e7d0adcf00074e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_f27c4cf98441b41d3e7d0adcf00074e2.jpg not downloaded yet
2025-12-05 20:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6e4b6b-5ee3-52ca-b704-2f889832d608 with identifier: YC62647
2025-12-05 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e4b6b-5ee3-52ca-b704-2f889832d608 with scrape type 2
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6e4b6b-5ee3-52ca-b704-2f889832d608 with scrape type 2
2025-12-05 20:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f6e4b6b-5ee3-52ca-b704-2f889832d608, identifier: YC62647
2025-12-05 20:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10a4aa3-2f0a-54db-bc69-69712257964f with identifier: GU76780
2025-12-05 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10a4aa3-2f0a-54db-bc69-69712257964f with scrape type 2
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b10a4aa3-2f0a-54db-bc69-69712257964f with scrape type 2
2025-12-05 20:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b10a4aa3-2f0a-54db-bc69-69712257964f, identifier: GU76780
2025-12-05 20:01:23 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 90 pages/min), scraped 24 items (at 24 items/min)
2025-12-05 20:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f6e4b6b-5ee3-52ca-b704-2f889832d608 with identifier: YC62647
2025-12-05 20:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f6e4b6b-5ee3-52ca-b704-2f889832d608 with identifier: YC62647
2025-12-05 20:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f6e4b6b-5ee3-52ca-b704-2f889832d608 with identifier: YC62647 to the API
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC62647>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:01:22Z',
 'fuel_type': 'petrol',
 'id': '9f6e4b6b-5ee3-52ca-b704-2f889832d608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC62647',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 31039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
 'transmission': 'automatic',
 'trim': 'ACT',
 'year': 2022}
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC62647%27 HTTP/1.1" 200 None
2025-12-05 20:01:24 [auto1.it] INFO: Saving data for YC62647: {'auction_closing_time': 1765036882.0, 'created_time': 1764878437.79355, 'last_price_update_time': 1764964884.110257}
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YC62647') HTTP/1.1" 204 0
2025-12-05 20:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b10a4aa3-2f0a-54db-bc69-69712257964f with identifier: GU76780
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2025-12-05 20:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b10a4aa3-2f0a-54db-bc69-69712257964f with identifier: GU76780
2025-12-05 20:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b10a4aa3-2f0a-54db-bc69-69712257964f with identifier: GU76780 to the API
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GU76780>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:26:23Z',
 'fuel_type': 'petrol',
 'id': 'b10a4aa3-2f0a-54db-bc69-69712257964f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU76780',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 38116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU76780%27 HTTP/1.1" 200 None
2025-12-05 20:01:24 [auto1.it] INFO: Saving data for GU76780: {'auction_closing_time': 1765038383.0, 'created_time': 1762286744.748349, 'last_price_update_time': 1764964884.653312}
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU76780') HTTP/1.1" 204 0
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_debf7c50d4b742a58253779951adc82f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_debf7c50d4b742a58253779951adc82f.jpg not downloaded yet
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_bd77db08fa373bce727805fa9cc20fab.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bd77db08fa373bce727805fa9cc20fab.jpg not downloaded yet
2025-12-05 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_2c45cdd382e8b3cffd7d3dbdf14634cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae006bad0>
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_73c631a9d6b8fdab7c55f9c3b5761f2f.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_73c631a9d6b8fdab7c55f9c3b5761f2f.jpg saved to cache
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03706d0>
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_830a2f05faeb25968b725373faf39ff8.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_830a2f05faeb25968b725373faf39ff8.jpg saved to cache
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_33a5a1a8e91ac911c3167f87ef7622a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_08a064814b7ddd32b97d1a15e2bf46d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_08a064814b7ddd32b97d1a15e2bf46d7.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_28659fc23179d5633f3d0571ef0329c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_28659fc23179d5633f3d0571ef0329c9.jpg not downloaded yet
2025-12-05 20:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_bb09e4fd2bca338f5fc03a1539d62d6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bb09e4fd2bca338f5fc03a1539d62d6e.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_64e949b5173e4ef0e07b42b9bddda909.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_64e949b5173e4ef0e07b42b9bddda909.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_5fbbe5007682c06ca36d137e7eded07a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_5fbbe5007682c06ca36d137e7eded07a.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_5602d8f5547f4c4bcfddd217d068eeaf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5602d8f5547f4c4bcfddd217d068eeaf.jpg not downloaded yet
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0088c50>
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_2c45cdd382e8b3cffd7d3dbdf14634cd.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_2c45cdd382e8b3cffd7d3dbdf14634cd.jpg saved to cache
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_dbfad8128015de917c8ba692a475f18a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_688047d6114506be8a1ae4e429c594f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_688047d6114506be8a1ae4e429c594f3.jpg not downloaded yet
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_97700c1ac42dbcce604b96622c5392e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_97700c1ac42dbcce604b96622c5392e6.jpg not downloaded yet
2025-12-05 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_46d79bd5f675249e95b845d4973ca698.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae008fd90>
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_33a5a1a8e91ac911c3167f87ef7622a5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_33a5a1a8e91ac911c3167f87ef7622a5.jpg saved to cache
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_9280f6b1a7e5222276c90cbf640760b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9280f6b1a7e5222276c90cbf640760b3.jpg not downloaded yet
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_5b6c94304a7743e8ed82af6a1cc0defb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5b6c94304a7743e8ed82af6a1cc0defb.jpg not downloaded yet
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0452810>
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_dbfad8128015de917c8ba692a475f18a.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_dbfad8128015de917c8ba692a475f18a.jpg saved to cache
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0162010>
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_46d79bd5f675249e95b845d4973ca698.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_46d79bd5f675249e95b845d4973ca698.jpg saved to cache
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bf426924dd60ef8a9b0cec73427d2e54.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_a927ea4bc98a41aceb35f5badeeabbe5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_a927ea4bc98a41aceb35f5badeeabbe5.jpg not downloaded yet
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e909125cfb6113cabfaffdb4f17079cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY71307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_9ec0791de126bd03278aec11a0e26089.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9ec0791de126bd03278aec11a0e26089.jpg not downloaded yet
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_bf8f01fa994cd39eb9f0305f52a80abd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bf8f01fa994cd39eb9f0305f52a80abd.jpg not downloaded yet
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_d29d182163e013abe0c7cb23781eb062.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_d29d182163e013abe0c7cb23781eb062.jpg not downloaded yet
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_bb8ac807af26b941e5bbf6d2a91f3620.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bb8ac807af26b941e5bbf6d2a91f3620.jpg not downloaded yet
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00df6d0>
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_bf426924dd60ef8a9b0cec73427d2e54.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bf426924dd60ef8a9b0cec73427d2e54.jpg saved to cache
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_b9ba6b4a9e7ab20e4c088987d3ba3753.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_b9ba6b4a9e7ab20e4c088987d3ba3753.jpg not downloaded yet
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4c62276a2625201dc775fc5c4435d4bc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_bf2708ada3d4d6f36272d53ae1d58183.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_6d729488237ec099637b4b0efe592c0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7158f4749a79a9137e263c4328c82e75.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_680462733d94ed4df358dea603eba279.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_680462733d94ed4df358dea603eba279.jpg not downloaded yet
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT08597> (referer: https://www.auto1.com/v1/car-details-view/RT08597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0343ed0>
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_e909125cfb6113cabfaffdb4f17079cb.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e909125cfb6113cabfaffdb4f17079cb.jpg saved to cache
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_3c44781317eee147ed3d854ef6e03555.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_5fbbe5007682c06ca36d137e7eded07a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_453843e1abf7afa7079c2b98337db9cb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_f27c4cf98441b41d3e7d0adcf00074e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_76a68bd067132608fe251b88709eca72.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0613090>
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_4c62276a2625201dc775fc5c4435d4bc.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4c62276a2625201dc775fc5c4435d4bc.jpg saved to cache
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00bbfd0>
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_bf2708ada3d4d6f36272d53ae1d58183.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_bf2708ada3d4d6f36272d53ae1d58183.jpg saved to cache
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e7250>
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_6d729488237ec099637b4b0efe592c0a.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_6d729488237ec099637b4b0efe592c0a.jpg saved to cache
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae06129d0>
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_7158f4749a79a9137e263c4328c82e75.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7158f4749a79a9137e263c4328c82e75.jpg saved to cache
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310c3fd8-c9c1-5ab0-b360-7f7d930b1555 with identifier: RT08597
2025-12-05 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310c3fd8-c9c1-5ab0-b360-7f7d930b1555 with scrape type 2
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310c3fd8-c9c1-5ab0-b360-7f7d930b1555 with scrape type 2
2025-12-05 20:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 310c3fd8-c9c1-5ab0-b360-7f7d930b1555, identifier: RT08597
2025-12-05 20:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 310c3fd8-c9c1-5ab0-b360-7f7d930b1555 with identifier: RT08597
2025-12-05 20:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 310c3fd8-c9c1-5ab0-b360-7f7d930b1555 with identifier: RT08597
2025-12-05 20:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175646
2025-12-05 20:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 310c3fd8-c9c1-5ab0-b360-7f7d930b1555 spider: auto1.it
2025-12-05 20:01:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 310c3fd8-c9c1-5ab0-b360-7f7d930b1555 due to rule: high_mileage_for_country.json, error: 175646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175646
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:24:28Z',
 'fuel_type': 'petrol',
 'id': '310c3fd8-c9c1-5ab0-b360-7f7d930b1555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT08597',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 175646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2019}
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT08597%27 HTTP/1.1" 200 None
2025-12-05 20:01:29 [auto1.it] INFO: Saving data for RT08597: {'auction_closing_time': 1765038268.0, 'created_time': 1763582622.334094, 'last_price_update_time': 1764964889.559448}
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT08597') HTTP/1.1" 204 0
2025-12-05 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bb8ac807af26b941e5bbf6d2a91f3620.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9280f6b1a7e5222276c90cbf640760b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f8bd7fe750bdab2e0df4cc4a9d1dc4d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0530510>
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_3c44781317eee147ed3d854ef6e03555.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_3c44781317eee147ed3d854ef6e03555.jpg saved to cache
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0186550>
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_5fbbe5007682c06ca36d137e7eded07a.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_5fbbe5007682c06ca36d137e7eded07a.jpg saved to cache
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0510350>
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_453843e1abf7afa7079c2b98337db9cb.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_453843e1abf7afa7079c2b98337db9cb.jpg saved to cache
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01a05d0>
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_f27c4cf98441b41d3e7d0adcf00074e2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_f27c4cf98441b41d3e7d0adcf00074e2.jpg saved to cache
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0185610>
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_76a68bd067132608fe251b88709eca72.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_76a68bd067132608fe251b88709eca72.jpg saved to cache
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05c8e50>
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_bb8ac807af26b941e5bbf6d2a91f3620.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bb8ac807af26b941e5bbf6d2a91f3620.jpg saved to cache
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0499b10>
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_9280f6b1a7e5222276c90cbf640760b3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9280f6b1a7e5222276c90cbf640760b3.jpg saved to cache
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04987d0>
2025-12-05 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_f8bd7fe750bdab2e0df4cc4a9d1dc4d0.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f8bd7fe750bdab2e0df4cc4a9d1dc4d0.jpg saved to cache
2025-12-05 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88d200cf749dc10c0a9cdd311bff97cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_a927ea4bc98a41aceb35f5badeeabbe5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5b6c94304a7743e8ed82af6a1cc0defb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_d29d182163e013abe0c7cb23781eb062.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_688047d6114506be8a1ae4e429c594f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5602d8f5547f4c4bcfddd217d068eeaf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04c81d0>
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_88d200cf749dc10c0a9cdd311bff97cc.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88d200cf749dc10c0a9cdd311bff97cc.jpg saved to cache
2025-12-05 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_b9ba6b4a9e7ab20e4c088987d3ba3753.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bb09e4fd2bca338f5fc03a1539d62d6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_680462733d94ed4df358dea603eba279.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02fabd0>
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_a927ea4bc98a41aceb35f5badeeabbe5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_a927ea4bc98a41aceb35f5badeeabbe5.jpg saved to cache
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae045dd50>
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_5b6c94304a7743e8ed82af6a1cc0defb.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5b6c94304a7743e8ed82af6a1cc0defb.jpg saved to cache
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0267050>
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_d29d182163e013abe0c7cb23781eb062.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_d29d182163e013abe0c7cb23781eb062.jpg saved to cache
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0466590>
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_688047d6114506be8a1ae4e429c594f3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_688047d6114506be8a1ae4e429c594f3.jpg saved to cache
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0572c90>
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_5602d8f5547f4c4bcfddd217d068eeaf.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5602d8f5547f4c4bcfddd217d068eeaf.jpg saved to cache
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_08a064814b7ddd32b97d1a15e2bf46d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03467d0>
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_b9ba6b4a9e7ab20e4c088987d3ba3753.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_b9ba6b4a9e7ab20e4c088987d3ba3753.jpg saved to cache
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e7d10>
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_bb09e4fd2bca338f5fc03a1539d62d6e.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bb09e4fd2bca338f5fc03a1539d62d6e.jpg saved to cache
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e5910>
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_680462733d94ed4df358dea603eba279.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_680462733d94ed4df358dea603eba279.jpg saved to cache
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_debf7c50d4b742a58253779951adc82f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_9daeaa08549dd809cfdbf1cedf759097.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04bfcd0>
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_08a064814b7ddd32b97d1a15e2bf46d7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_08a064814b7ddd32b97d1a15e2bf46d7.jpg saved to cache
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fdf48758a5581394825c1b0ac80c5bbe.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e3f088963a0b0fdce1bb5acf44865c03.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae024c490>
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_debf7c50d4b742a58253779951adc82f.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_debf7c50d4b742a58253779951adc82f.jpg saved to cache
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f2850>
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fcf%252F8ccfe3564678d99b3528ddda186dcda6%252Fpa%252FHP29933_9daeaa08549dd809cfdbf1cedf759097.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_9daeaa08549dd809cfdbf1cedf759097.jpg saved to cache
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639
2025-12-05 20:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7e4acac-2fc4-54c7-bfe6-e67c6fb52639, skipping ID generation
2025-12-05 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 with scrape type 1
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 from tracking dictionaries
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 sending to next pipeline
2025-12-05 20:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7e4acac-2fc4-54c7-bfe6-e67c6fb52639, identifier: HP29933
2025-12-05 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 with identifier: HP29933
2025-12-05 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 with identifier: HP29933
2025-12-05 20:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a7e4acac-2fc4-54c7-bfe6-e67c6fb52639 with identifier: HP29933 to the API
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_9daeaa08549dd809cfdbf1cedf759097.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:58:45Z',
 'fuel_type': 'diesel',
 'id': 'a7e4acac-2fc4-54c7-bfe6-e67c6fb52639',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP29933',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 135416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7c95f753a0715dd212bbe1bbae9a71d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_487cb3200c6518f3054e7c435d130c0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_3c44781317eee147ed3d854ef6e03555.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_73c631a9d6b8fdab7c55f9c3b5761f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_2c45cdd382e8b3cffd7d3dbdf14634cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_33a5a1a8e91ac911c3167f87ef7622a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bf426924dd60ef8a9b0cec73427d2e54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_46d79bd5f675249e95b845d4973ca698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_7158f4749a79a9137e263c4328c82e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_9daeaa08549dd809cfdbf1cedf759097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_debf7c50d4b742a58253779951adc82f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_08a064814b7ddd32b97d1a15e2bf46d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_bb09e4fd2bca338f5fc03a1539d62d6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_5fbbe5007682c06ca36d137e7eded07a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e4acac-2fc4-54c7-bfe6-e67c6fb52639/a7e4acac-2fc4-54c7-bfe6-e67c6fb52639_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/cf/8ccfe3564678d99b3528ddda186dcda6/pa/HP29933_688047d6114506be8a1ae4e429c594f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D165 Mild-Hybrid AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2021}
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP29933%27 HTTP/1.1" 200 None
2025-12-05 20:01:38 [auto1.it] INFO: Saving data for HP29933: {'created_time': 1764964898.307773, 'last_price_update_time': 1764964898.307786, 'auction_closing_time': 1765040325.0}
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP29933') HTTP/1.1" 204 0
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_10dac1bb29bc2694d46c4d394c022193.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY71307> (referer: https://www.auto1.com/v1/car-details-view/BY71307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP33794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ19818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_9412db46fc5598258b2b7e288ac543d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04857d0>
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_fdf48758a5581394825c1b0ac80c5bbe.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fdf48758a5581394825c1b0ac80c5bbe.jpg saved to cache
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04bb450>
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_e3f088963a0b0fdce1bb5acf44865c03.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e3f088963a0b0fdce1bb5acf44865c03.jpg saved to cache
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bb043243fcbc5420fad821304143f0bd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0266010>
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_10dac1bb29bc2694d46c4d394c022193.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_10dac1bb29bc2694d46c4d394c022193.jpg saved to cache
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 787d5d89-ba72-51e9-809c-b0396e75202e with identifier: BY71307
2025-12-05 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 787d5d89-ba72-51e9-809c-b0396e75202e with scrape type 2
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 787d5d89-ba72-51e9-809c-b0396e75202e with scrape type 2
2025-12-05 20:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 787d5d89-ba72-51e9-809c-b0396e75202e, identifier: BY71307
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0069bd0>
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_9412db46fc5598258b2b7e288ac543d5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_9412db46fc5598258b2b7e288ac543d5.jpg saved to cache
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 787d5d89-ba72-51e9-809c-b0396e75202e with identifier: BY71307
2025-12-05 20:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 787d5d89-ba72-51e9-809c-b0396e75202e with identifier: BY71307
2025-12-05 20:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 787d5d89-ba72-51e9-809c-b0396e75202e with identifier: BY71307 to the API
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY71307>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 272,
 'expiration_date': '2025-12-06T16:22:23Z',
 'fuel_type': 'diesel',
 'id': '787d5d89-ba72-51e9-809c-b0396e75202e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY71307',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 114570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY71307%27 HTTP/1.1" 200 None
2025-12-05 20:01:40 [auto1.it] INFO: Saving data for BY71307: {'auction_closing_time': 1765038143.0, 'created_time': 1764878452.004555, 'last_price_update_time': 1764964900.245717}
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY71307') HTTP/1.1" 204 0
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_75103b85a3bb70ed9fd349b7d14235bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_212e7eb6b5adcf9998ca64a297bed772.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03334d0>
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_bb043243fcbc5420fad821304143f0bd.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bb043243fcbc5420fad821304143f0bd.jpg saved to cache
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bf8f01fa994cd39eb9f0305f52a80abd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9ec0791de126bd03278aec11a0e26089.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_95602721a51cd3b82f8dc312d03d7e12.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_abf48e36de950e88cb9e62466c8e6736.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e76d0>
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_75103b85a3bb70ed9fd349b7d14235bb.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_75103b85a3bb70ed9fd349b7d14235bb.jpg saved to cache
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f8990>
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_212e7eb6b5adcf9998ca64a297bed772.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_212e7eb6b5adcf9998ca64a297bed772.jpg saved to cache
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP51001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00990d0>
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_bf8f01fa994cd39eb9f0305f52a80abd.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bf8f01fa994cd39eb9f0305f52a80abd.jpg saved to cache
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b7c50>
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_9ec0791de126bd03278aec11a0e26089.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9ec0791de126bd03278aec11a0e26089.jpg saved to cache
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0265010>
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_95602721a51cd3b82f8dc312d03d7e12.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_95602721a51cd3b82f8dc312d03d7e12.jpg saved to cache
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae040fcd0>
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_abf48e36de950e88cb9e62466c8e6736.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_abf48e36de950e88cb9e62466c8e6736.jpg saved to cache
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_64e949b5173e4ef0e07b42b9bddda909.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_34cba89dee48b26e1e361c37c3411518.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ19818> (referer: https://www.auto1.com/v1/car-details-view/AJ19818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU55594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW13967/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_97700c1ac42dbcce604b96622c5392e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b4890>
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_64e949b5173e4ef0e07b42b9bddda909.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_64e949b5173e4ef0e07b42b9bddda909.jpg saved to cache
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0265cd0>
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_34cba89dee48b26e1e361c37c3411518.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_34cba89dee48b26e1e361c37c3411518.jpg saved to cache
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_28659fc23179d5633f3d0571ef0329c9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_1c917c43fa0f8a5ac57664d529253fbb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_c332efb6f5a8442ee64810744e8af9da.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP33794> (referer: https://www.auto1.com/v1/car-details-view/LP33794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 496318aa-90cd-522e-9de0-7682772070f3 with identifier: AJ19818
2025-12-05 20:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496318aa-90cd-522e-9de0-7682772070f3 with scrape type 1
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_5d59a222d605368fbba239df7d3264b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_5d59a222d605368fbba239df7d3264b3.jpg not downloaded yet
2025-12-05 20:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d86d0>
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_97700c1ac42dbcce604b96622c5392e6.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_97700c1ac42dbcce604b96622c5392e6.jpg saved to cache
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_0c332a3f45822a9ffe32b8e37428de6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_0c332a3f45822a9ffe32b8e37428de6e.jpg not downloaded yet
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_02faad4f6b15c211fbac996ecf750e42.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_02faad4f6b15c211fbac996ecf750e42.jpg not downloaded yet
2025-12-05 20:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a6a50>
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_28659fc23179d5633f3d0571ef0329c9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_28659fc23179d5633f3d0571ef0329c9.jpg saved to cache
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae24d50d0>
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_1c917c43fa0f8a5ac57664d529253fbb.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_1c917c43fa0f8a5ac57664d529253fbb.jpg saved to cache
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0177c50>
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fc3%252F1bc3b35cae106ef81ad4f11a71ab0634%252Fpa%252FUK96914_c332efb6f5a8442ee64810744e8af9da.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_c332efb6f5a8442ee64810744e8af9da.jpg saved to cache
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b
2025-12-05 20:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4bdd16e-2c9c-5000-9ccb-37d01e22912b, skipping ID generation
2025-12-05 20:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b with scrape type 1
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b4bdd16e-2c9c-5000-9ccb-37d01e22912b from tracking dictionaries
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4bdd16e-2c9c-5000-9ccb-37d01e22912b sending to next pipeline
2025-12-05 20:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4bdd16e-2c9c-5000-9ccb-37d01e22912b, identifier: UK96914
2025-12-05 20:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95cda29a-d755-523f-af36-5b48357ba94d with identifier: LP33794
2025-12-05 20:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95cda29a-d755-523f-af36-5b48357ba94d with scrape type 1
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_0ac6762806c9a7cb73be6342fcfe0e30.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_0ac6762806c9a7cb73be6342fcfe0e30.jpg not downloaded yet
2025-12-05 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bd77db08fa373bce727805fa9cc20fab.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4bdd16e-2c9c-5000-9ccb-37d01e22912b with identifier: UK96914
2025-12-05 20:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4bdd16e-2c9c-5000-9ccb-37d01e22912b with identifier: UK96914
2025-12-05 20:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4bdd16e-2c9c-5000-9ccb-37d01e22912b with identifier: UK96914 to the API
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_c332efb6f5a8442ee64810744e8af9da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:32:35Z',
 'fuel_type': 'petrol',
 'id': 'b4bdd16e-2c9c-5000-9ccb-37d01e22912b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK96914',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 43688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_1c917c43fa0f8a5ac57664d529253fbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_c332efb6f5a8442ee64810744e8af9da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_34cba89dee48b26e1e361c37c3411518.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_95602721a51cd3b82f8dc312d03d7e12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_212e7eb6b5adcf9998ca64a297bed772.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_5e202dee931150f228bf237cea83511b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_9412db46fc5598258b2b7e288ac543d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e3f088963a0b0fdce1bb5acf44865c03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_e909125cfb6113cabfaffdb4f17079cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_830a2f05faeb25968b725373faf39ff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_66f8c273edcbed0fbddd4cc60846218d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_b73cfacb2202ecca64a49b0a48503f7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30718,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_7343c771e85b0f85f7f3b7f4bfbed0d3.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_a534ee504bf83144192d401bf85a82c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bdd16e-2c9c-5000-9ccb-37d01e22912b/b4bdd16e-2c9c-5000-9ccb-37d01e22912b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/c3/1bc3b35cae106ef81ad4f11a71ab0634/pa/UK96914_8dc7cd1aa3c07ef84d5119529aea9dd3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2017}
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK96914%27 HTTP/1.1" 200 None
2025-12-05 20:01:45 [auto1.it] INFO: Saving data for UK96914: {'created_time': 1764964905.683475, 'last_price_update_time': 1764964905.683491, 'auction_closing_time': 1765038755.0}
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK96914') HTTP/1.1" 204 0
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_67a41564890b748771ee8ff5e39263fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_67a41564890b748771ee8ff5e39263fa.jpg not downloaded yet
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_7a12b741a0d279599080c3e578e550b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_7a12b741a0d279599080c3e578e550b5.jpg not downloaded yet
2025-12-05 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_5d59a222d605368fbba239df7d3264b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_6f268b8c3b3a105f6c8b19f34c322028.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_6f268b8c3b3a105f6c8b19f34c322028.jpg not downloaded yet
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_72fab4e32c7676085a2e1a339e39f97a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_72fab4e32c7676085a2e1a339e39f97a.jpg not downloaded yet
2025-12-05 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00923d0>
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F51%252F5e51e909958bb6fae2b7e2b4432ee7ff%252Fpa%252FFJ07347_bd77db08fa373bce727805fa9cc20fab.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bd77db08fa373bce727805fa9cc20fab.jpg saved to cache
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2e879e6-56d0-56bb-a0e6-5334db808eee
2025-12-05 20:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2e879e6-56d0-56bb-a0e6-5334db808eee, skipping ID generation
2025-12-05 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e879e6-56d0-56bb-a0e6-5334db808eee with scrape type 1
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a2e879e6-56d0-56bb-a0e6-5334db808eee from tracking dictionaries
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2e879e6-56d0-56bb-a0e6-5334db808eee sending to next pipeline
2025-12-05 20:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2e879e6-56d0-56bb-a0e6-5334db808eee, identifier: FJ07347
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_1c7588f150e89a0f694d87a2aabd9846.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1c7588f150e89a0f694d87a2aabd9846.jpg not downloaded yet
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_a600f64807b31f73bc49dc7ad9b6b085.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_a600f64807b31f73bc49dc7ad9b6b085.jpg not downloaded yet
2025-12-05 20:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2e879e6-56d0-56bb-a0e6-5334db808eee with identifier: FJ07347
2025-12-05 20:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2e879e6-56d0-56bb-a0e6-5334db808eee with identifier: FJ07347
2025-12-05 20:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2e879e6-56d0-56bb-a0e6-5334db808eee with identifier: FJ07347 to the API
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bd77db08fa373bce727805fa9cc20fab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:54:28Z',
 'fuel_type': 'petrol',
 'id': 'a2e879e6-56d0-56bb-a0e6-5334db808eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ07347',
 'listing': 'auction',
 'location': 'IT, Siracusa',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 71087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_f27c4cf98441b41d3e7d0adcf00074e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3203600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bd77db08fa373bce727805fa9cc20fab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_28659fc23179d5633f3d0571ef0329c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_64e949b5173e4ef0e07b42b9bddda909.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3016342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5602d8f5547f4c4bcfddd217d068eeaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_97700c1ac42dbcce604b96622c5392e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9280f6b1a7e5222276c90cbf640760b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_5b6c94304a7743e8ed82af6a1cc0defb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_a927ea4bc98a41aceb35f5badeeabbe5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_9ec0791de126bd03278aec11a0e26089.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3013606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bf8f01fa994cd39eb9f0305f52a80abd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3066958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_d29d182163e013abe0c7cb23781eb062.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_bb8ac807af26b941e5bbf6d2a91f3620.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_b9ba6b4a9e7ab20e4c088987d3ba3753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e879e6-56d0-56bb-a0e6-5334db808eee/a2e879e6-56d0-56bb-a0e6-5334db808eee_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/51/5e51e909958bb6fae2b7e2b4432ee7ff/pa/FJ07347_680462733d94ed4df358dea603eba279.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ07347%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [auto1.it] INFO: Saving data for FJ07347: {'created_time': 1764964906.808396, 'last_price_update_time': 1764964906.808407, 'auction_closing_time': 1765040068.0}
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ07347') HTTP/1.1" 204 0
2025-12-05 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_67a41564890b748771ee8ff5e39263fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_4ba7c8df41dc555e35b3553b5f02788d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_4ba7c8df41dc555e35b3553b5f02788d.jpg not downloaded yet
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_b95846e222d1f083b0b4c9558ce56dd9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_b95846e222d1f083b0b4c9558ce56dd9.jpg not downloaded yet
2025-12-05 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU84839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d7610>
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_5d59a222d605368fbba239df7d3264b3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_5d59a222d605368fbba239df7d3264b3.jpg saved to cache
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_45e62820d01bd12da830c71479235162.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_45e62820d01bd12da830c71479235162.jpg not downloaded yet
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_879f52bc38f2db5963be6ece361714df.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_879f52bc38f2db5963be6ece361714df.jpg not downloaded yet
2025-12-05 20:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_c261fc909a148065770e4e4eb4339b71.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_c261fc909a148065770e4e4eb4339b71.jpg not downloaded yet
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_e2c449e2f33c86ef812be3c4f9a7e843.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_e2c449e2f33c86ef812be3c4f9a7e843.jpg not downloaded yet
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae024e750>
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_67a41564890b748771ee8ff5e39263fa.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_67a41564890b748771ee8ff5e39263fa.jpg saved to cache
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_a600f64807b31f73bc49dc7ad9b6b085.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_1b98dbf947db8bcb27f28f30283a318f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1b98dbf947db8bcb27f28f30283a318f.jpg not downloaded yet
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_bf8807e99bc810d1ca49084f27c8a17b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_bf8807e99bc810d1ca49084f27c8a17b.jpg not downloaded yet
2025-12-05 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL50165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_14aff9fb00f9f6e4e142d5f084d42c45.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_14aff9fb00f9f6e4e142d5f084d42c45.jpg not downloaded yet
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_8613520e11a7c797370db6cd47b385a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_8613520e11a7c797370db6cd47b385a5.jpg not downloaded yet
2025-12-05 20:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_d16c2c9a00d204ba42c6ee7f007289e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_d16c2c9a00d204ba42c6ee7f007289e8.jpg not downloaded yet
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_53ca22800908b0d83bdefcc9d320171b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_53ca22800908b0d83bdefcc9d320171b.jpg not downloaded yet
2025-12-05 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_1ce2a217f93c0e0e1e5d66ac215d165b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0068810>
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_a600f64807b31f73bc49dc7ad9b6b085.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_a600f64807b31f73bc49dc7ad9b6b085.jpg saved to cache
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_ee1e9b72278a11393137934dbbce0aaa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_ee1e9b72278a11393137934dbbce0aaa.jpg not downloaded yet
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_5f1829ab3afb375ac166d6ac58490ae4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_5f1829ab3afb375ac166d6ac58490ae4.jpg not downloaded yet
2025-12-05 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP51001> (referer: https://www.auto1.com/v1/car-details-view/FP51001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU55594> (referer: https://www.auto1.com/v1/car-details-view/WU55594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW13967> (referer: https://www.auto1.com/v1/car-details-view/TW13967/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP22831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f84252e75ad6c54a863a1fff979304aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_996bc9055998c22e183b066755562018.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_996bc9055998c22e183b066755562018.jpg not downloaded yet
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_f928a3886334ce66b6fe93b468434073.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_f928a3886334ce66b6fe93b468434073.jpg not downloaded yet
2025-12-05 20:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e4950>
2025-12-05 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff7%252F3ff7aae56d90594f57973f7264f0c26f%252Fpa%252FCM21448_1ce2a217f93c0e0e1e5d66ac215d165b.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_1ce2a217f93c0e0e1e5d66ac215d165b.jpg saved to cache
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68c1767f-1f86-53b6-a476-487f6c614386
2025-12-05 20:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68c1767f-1f86-53b6-a476-487f6c614386, skipping ID generation
2025-12-05 20:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c1767f-1f86-53b6-a476-487f6c614386 with scrape type 1
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 68c1767f-1f86-53b6-a476-487f6c614386 from tracking dictionaries
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68c1767f-1f86-53b6-a476-487f6c614386 sending to next pipeline
2025-12-05 20:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 68c1767f-1f86-53b6-a476-487f6c614386, identifier: CM21448
2025-12-05 20:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68c1767f-1f86-53b6-a476-487f6c614386 with identifier: CM21448
2025-12-05 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68c1767f-1f86-53b6-a476-487f6c614386 with identifier: CM21448
2025-12-05 20:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68c1767f-1f86-53b6-a476-487f6c614386 with identifier: CM21448 to the API
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_1ce2a217f93c0e0e1e5d66ac215d165b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2025-12-06T16:14:42Z',
 'fuel_type': 'petrol',
 'id': '68c1767f-1f86-53b6-a476-487f6c614386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM21448',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 55972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2341561,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_1ce2a217f93c0e0e1e5d66ac215d165b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_abf48e36de950e88cb9e62466c8e6736.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bb043243fcbc5420fad821304143f0bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_bc4060ee72cb13da8b446291c80079d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_10dac1bb29bc2694d46c4d394c022193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409126,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88d200cf749dc10c0a9cdd311bff97cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_dbfad8128015de917c8ba692a475f18a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2398884,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_76a68bd067132608fe251b88709eca72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2297734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4c62276a2625201dc775fc5c4435d4bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_ac05c82d774e9285aa13cbca481c7ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_4407c0add6abbac8ea822a9732d38039.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_88f9fd6bed25ff976efc7d049e845653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628050,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_6d729488237ec099637b4b0efe592c0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_06b6bb2a7d07124ae16aac3cde853160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68c1767f-1f86-53b6-a476-487f6c614386/68c1767f-1f86-53b6-a476-487f6c614386_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f7/3ff7aae56d90594f57973f7264f0c26f/pa/CM21448_25f3c98a1a5623603fc0415b7c9604d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2017}
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM21448%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [auto1.it] INFO: Saving data for CM21448: {'created_time': 1764964909.154309, 'last_price_update_time': 1764964909.154318, 'auction_closing_time': 1765037682.0}
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CM21448') HTTP/1.1" 204 0
2025-12-05 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_8613520e11a7c797370db6cd47b385a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_63119ec271c2e3a25e0038762f3c5d3f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_63119ec271c2e3a25e0038762f3c5d3f.jpg not downloaded yet
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_cf32d9def210c7eacfbeb6ff7b1622fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_cf32d9def210c7eacfbeb6ff7b1622fd.jpg not downloaded yet
2025-12-05 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP59077> (referer: https://www.auto1.com/v1/car-details-view/FP59077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_ee3b2cfa68e5340702f29372dc4c38e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_ee3b2cfa68e5340702f29372dc4c38e8.jpg not downloaded yet
2025-12-05 20:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4e095d2-fab7-55d5-9528-42d8f29f1ec6 with identifier: FP51001
2025-12-05 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4e095d2-fab7-55d5-9528-42d8f29f1ec6 with scrape type 2
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4e095d2-fab7-55d5-9528-42d8f29f1ec6 with scrape type 2
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4e095d2-fab7-55d5-9528-42d8f29f1ec6, identifier: FP51001
2025-12-05 20:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85f5c51-aa49-568b-a929-e7a9d0eb00e7 with identifier: WU55594
2025-12-05 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85f5c51-aa49-568b-a929-e7a9d0eb00e7 with scrape type 2
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85f5c51-aa49-568b-a929-e7a9d0eb00e7 with scrape type 2
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d85f5c51-aa49-568b-a929-e7a9d0eb00e7, identifier: WU55594
2025-12-05 20:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6cb7a53-d2bd-5508-9561-820900130a4b with identifier: TW13967
2025-12-05 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6cb7a53-d2bd-5508-9561-820900130a4b with scrape type 1
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_adbc740a597cc45cac61aa19addddcdb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_adbc740a597cc45cac61aa19addddcdb.jpg not downloaded yet
2025-12-05 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b7410>
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_f84252e75ad6c54a863a1fff979304aa.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f84252e75ad6c54a863a1fff979304aa.jpg saved to cache
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:49 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_aa48b2956faf940d436fbfc085c66ed8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_aa48b2956faf940d436fbfc085c66ed8.jpg not downloaded yet
2025-12-05 20:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4e095d2-fab7-55d5-9528-42d8f29f1ec6 with identifier: FP51001
2025-12-05 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4e095d2-fab7-55d5-9528-42d8f29f1ec6 with identifier: FP51001
2025-12-05 20:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4e095d2-fab7-55d5-9528-42d8f29f1ec6 with identifier: FP51001 to the API
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP51001>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:59:41Z',
 'fuel_type': 'petrol',
 'id': 'd4e095d2-fab7-55d5-9528-42d8f29f1ec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP51001',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 27050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2023}
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP51001%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [auto1.it] INFO: Saving data for FP51001: {'auction_closing_time': 1765040381.0, 'created_time': 1763582489.207902, 'last_price_update_time': 1764964910.310808}
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FP51001') HTTP/1.1" 204 0
2025-12-05 20:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d85f5c51-aa49-568b-a929-e7a9d0eb00e7 with identifier: WU55594
2025-12-05 20:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d85f5c51-aa49-568b-a929-e7a9d0eb00e7 with identifier: WU55594
2025-12-05 20:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d85f5c51-aa49-568b-a929-e7a9d0eb00e7 with identifier: WU55594 to the API
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU55594>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:51:02Z',
 'fuel_type': 'diesel',
 'id': 'd85f5c51-aa49-568b-a929-e7a9d0eb00e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU55594',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 94888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU55594%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [auto1.it] INFO: Saving data for WU55594: {'auction_closing_time': 1765039862.0, 'created_time': 1763582732.889303, 'last_price_update_time': 1764964910.79875}
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU55594') HTTP/1.1" 204 0
2025-12-05 20:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_e824f03084b4fe31c2a64382fc1904e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e824f03084b4fe31c2a64382fc1904e7.jpg not downloaded yet
2025-12-05 20:01:50 [auto1.it] INFO: Found listing with ID: VL50172
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL50172%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [auto1.it] INFO: Scrape type for VL50172: 0
2025-12-05 20:01:50 [auto1.it] INFO: Found listing with ID: CG06923
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG06923%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [auto1.it] INFO: Scrape type for CG06923: 0
2025-12-05 20:01:50 [auto1.it] INFO: Found listing with ID: LJ12272
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ12272%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [auto1.it] INFO: Scrape type for LJ12272: 0
2025-12-05 20:01:50 [auto1.it] INFO: Found listing with ID: UA01461
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA01461%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [auto1.it] INFO: Scrape type for UA01461: 1
2025-12-05 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV25208> (referer: https://www.auto1.com/v1/car-details-view/XV25208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a4110>
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_8613520e11a7c797370db6cd47b385a5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_8613520e11a7c797370db6cd47b385a5.jpg saved to cache
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077
2025-12-05 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea32b545-f686-5edc-8f58-05785cbb0745 with scrape type 2
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea32b545-f686-5edc-8f58-05785cbb0745 with scrape type 2
2025-12-05 20:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea32b545-f686-5edc-8f58-05785cbb0745, identifier: FP59077
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_cbdc6ff3a5042a4008e0775c46e1f2d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_cbdc6ff3a5042a4008e0775c46e1f2d0.jpg not downloaded yet
2025-12-05 20:01:51 [auto1.it] INFO: Found listing with ID: BE54104
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54104%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [auto1.it] INFO: Scrape type for BE54104: 0
2025-12-05 20:01:51 [auto1.it] INFO: Found listing with ID: VJ46302
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ46302%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [auto1.it] INFO: Scrape type for VJ46302: 0
2025-12-05 20:01:51 [auto1.it] INFO: Found listing with ID: TD37557
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD37557%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [auto1.it] INFO: Scrape type for TD37557: 2
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU84869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077
2025-12-05 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077
2025-12-05 20:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077 to the API
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP59077>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2025-12-06T16:37:19Z',
 'fuel_type': 'diesel',
 'id': 'ea32b545-f686-5edc-8f58-05785cbb0745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP59077',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 113623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP59077%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [auto1.it] INFO: Saving data for FP59077: {'auction_closing_time': 1765039039.0, 'created_time': 1764360598.286508, 'last_price_update_time': 1764964911.742411}
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FP59077') HTTP/1.1" 204 0
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_ee3b2cfa68e5340702f29372dc4c38e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_f928a3886334ce66b6fe93b468434073.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_cf32d9def210c7eacfbeb6ff7b1622fd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_63119ec271c2e3a25e0038762f3c5d3f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_5600f83afbf25872a03ea838343f1448.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_5600f83afbf25872a03ea838343f1448.jpg not downloaded yet
2025-12-05 20:01:51 [auto1.it] INFO: Found listing with ID: LL77608
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL77608%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [auto1.it] INFO: Scrape type for LL77608: 2
2025-12-05 20:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_b862dbb65e8d5fc0a2a08a270ada3d42.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU84839> (referer: https://www.auto1.com/v1/car-details-view/LU84839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK36923> (referer: https://www.auto1.com/v1/car-details-view/CK36923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_17fcc681546c9d6bc7de850152f41b89.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_17fcc681546c9d6bc7de850152f41b89.jpg not downloaded yet
2025-12-05 20:01:51 [auto1.it] INFO: Found listing with ID: LC91200
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC91200%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [auto1.it] INFO: Scrape type for LC91200: 2
2025-12-05 20:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208
2025-12-05 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 035d9d29-7203-5eb2-b884-038b2213de1c with scrape type 2
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 035d9d29-7203-5eb2-b884-038b2213de1c with scrape type 2
2025-12-05 20:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 035d9d29-7203-5eb2-b884-038b2213de1c, identifier: XV25208
2025-12-05 20:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208
2025-12-05 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208
2025-12-05 20:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208 to the API
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV25208>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:30:03Z',
 'fuel_type': 'diesel',
 'id': '035d9d29-7203-5eb2-b884-038b2213de1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV25208',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 104931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2019}
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25208%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Saving data for XV25208: {'auction_closing_time': 1765038603.0, 'created_time': 1764878428.076522, 'last_price_update_time': 1764964912.349172}
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV25208') HTTP/1.1" 204 0
2025-12-05 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_ee1e9b72278a11393137934dbbce0aaa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_996bc9055998c22e183b066755562018.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_5f1829ab3afb375ac166d6ac58490ae4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_0a0f3e5650fa550ab6b3c1b4382c73d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_0a0f3e5650fa550ab6b3c1b4382c73d7.jpg not downloaded yet
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: BP94413
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP94413%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for BP94413: 0
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: KR86350
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR86350%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for KR86350: 0
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: KP05731
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP05731%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for KP05731: 0
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: VK82687
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK82687%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for VK82687: 2
2025-12-05 20:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_aa48b2956faf940d436fbfc085c66ed8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_38622880a87794eaaedfcbb3c4a615af.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_38622880a87794eaaedfcbb3c4a615af.jpg not downloaded yet
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: MD91819
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD91819%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for MD91819: 0
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: VH90153
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH90153%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for VH90153: 0
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: VN73607
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN73607%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for VN73607: 0
2025-12-05 20:01:52 [auto1.it] INFO: Found listing with ID: SA69794
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA69794%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [auto1.it] INFO: Scrape type for SA69794: 2
2025-12-05 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03afc50>
2025-12-05 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_ee3b2cfa68e5340702f29372dc4c38e8.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_ee3b2cfa68e5340702f29372dc4c38e8.jpg saved to cache
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae019b510>
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_f928a3886334ce66b6fe93b468434073.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_f928a3886334ce66b6fe93b468434073.jpg saved to cache
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022e350>
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_cf32d9def210c7eacfbeb6ff7b1622fd.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_cf32d9def210c7eacfbeb6ff7b1622fd.jpg saved to cache
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f9b10>
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_63119ec271c2e3a25e0038762f3c5d3f.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_63119ec271c2e3a25e0038762f3c5d3f.jpg saved to cache
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f8650>
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F4a%252F994a45e88e2c355c33d9838aa2f2c24d%252Fpa%252FWD58389_b862dbb65e8d5fc0a2a08a270ada3d42.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_b862dbb65e8d5fc0a2a08a270ada3d42.jpg saved to cache
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5df67ec-53d7-5a38-b082-aa91e2494adb
2025-12-05 20:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5df67ec-53d7-5a38-b082-aa91e2494adb, skipping ID generation
2025-12-05 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5df67ec-53d7-5a38-b082-aa91e2494adb with scrape type 1
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a5df67ec-53d7-5a38-b082-aa91e2494adb from tracking dictionaries
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5df67ec-53d7-5a38-b082-aa91e2494adb sending to next pipeline
2025-12-05 20:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5df67ec-53d7-5a38-b082-aa91e2494adb, identifier: WD58389
2025-12-05 20:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8f2d3d-8327-5947-aafe-c36f591e048a with identifier: LU84839
2025-12-05 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8f2d3d-8327-5947-aafe-c36f591e048a with scrape type 2
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a8f2d3d-8327-5947-aafe-c36f591e048a with scrape type 2
2025-12-05 20:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a8f2d3d-8327-5947-aafe-c36f591e048a, identifier: LU84839
2025-12-05 20:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923
2025-12-05 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7cf052-f32d-5a7a-9222-fac3c4728fdb with scrape type 2
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7cf052-f32d-5a7a-9222-fac3c4728fdb with scrape type 2
2025-12-05 20:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd7cf052-f32d-5a7a-9222-fac3c4728fdb, identifier: CK36923
2025-12-05 20:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5df67ec-53d7-5a38-b082-aa91e2494adb with identifier: WD58389
2025-12-05 20:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5df67ec-53d7-5a38-b082-aa91e2494adb with identifier: WD58389
2025-12-05 20:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5df67ec-53d7-5a38-b082-aa91e2494adb with identifier: WD58389 to the API
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_b862dbb65e8d5fc0a2a08a270ada3d42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:28:00Z',
 'fuel_type': 'petrol',
 'id': 'a5df67ec-53d7-5a38-b082-aa91e2494adb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD58389',
 'listing': 'auction',
 'location': 'IT, Varese',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 63305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_7254a4111c78e676bc0bdb789a3391f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3093517,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_2d6007f9fca289938c591f2a43e3470f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_45461ba9baa294a6a29ddc84dfad3176.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670981,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_b862dbb65e8d5fc0a2a08a270ada3d42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586520,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_1b502450a164c356d958d475fa1bd9f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491179,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f84252e75ad6c54a863a1fff979304aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_75103b85a3bb70ed9fd349b7d14235bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_96316f29ae69a986001c634b61e1dcb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_d357fcf81afb6697bf79fe9875e9fa16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fdf48758a5581394825c1b0ac80c5bbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_bf2708ada3d4d6f36272d53ae1d58183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_f8bd7fe750bdab2e0df4cc4a9d1dc4d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27153,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_e003b6de31abadc491675b5a9221b8bb.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_453843e1abf7afa7079c2b98337db9cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5df67ec-53d7-5a38-b082-aa91e2494adb/a5df67ec-53d7-5a38-b082-aa91e2494adb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/4a/994a45e88e2c355c33d9838aa2f2c24d/pa/WD58389_fae0dbc956bf7ac411fc74a73c0a4e44.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Admired',
 'transmission': 'automatic',
 'trim': 'Admired',
 'year': 2020}
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD58389%27 HTTP/1.1" 200 None
2025-12-05 20:01:55 [auto1.it] INFO: Saving data for WD58389: {'created_time': 1764964915.151841, 'last_price_update_time': 1764964915.151852, 'auction_closing_time': 1765038480.0}
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD58389') HTTP/1.1" 204 0
2025-12-05 20:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a8f2d3d-8327-5947-aafe-c36f591e048a with identifier: LU84839
2025-12-05 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a8f2d3d-8327-5947-aafe-c36f591e048a with identifier: LU84839
2025-12-05 20:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a8f2d3d-8327-5947-aafe-c36f591e048a with identifier: LU84839 to the API
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LU84839>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:22:26Z',
 'fuel_type': 'diesel',
 'id': '3a8f2d3d-8327-5947-aafe-c36f591e048a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU84839',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 144569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU84839%27 HTTP/1.1" 200 None
2025-12-05 20:01:55 [auto1.it] INFO: Saving data for LU84839: {'auction_closing_time': 1765038146.0, 'created_time': 1763150782.365343, 'last_price_update_time': 1764964915.698899}
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU84839') HTTP/1.1" 204 0
2025-12-05 20:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923
2025-12-05 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923
2025-12-05 20:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923 to the API
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK36923>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 380,
 'expiration_date': '2025-12-06T16:21:06Z',
 'fuel_type': 'petrol',
 'id': 'fd7cf052-f32d-5a7a-9222-fac3c4728fdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK36923',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 47024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 45 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK36923%27 HTTP/1.1" 200 None
2025-12-05 20:01:56 [auto1.it] INFO: Saving data for CK36923: {'auction_closing_time': 1765038066.0, 'created_time': 1763582475.957342, 'last_price_update_time': 1764964916.317465}
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK36923') HTTP/1.1" 204 0
2025-12-05 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_cbdc6ff3a5042a4008e0775c46e1f2d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_17fcc681546c9d6bc7de850152f41b89.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_7eef41de2841b6fccb570357719ebcdb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7eef41de2841b6fccb570357719ebcdb.jpg not downloaded yet
2025-12-05 20:01:56 [auto1.it] INFO: Found listing with ID: WW19272
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19272%27 HTTP/1.1" 200 None
2025-12-05 20:01:56 [auto1.it] INFO: Scrape type for WW19272: 2
2025-12-05 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL50165> (referer: https://www.auto1.com/v1/car-details-view/HL50165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01879d0>
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_ee1e9b72278a11393137934dbbce0aaa.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_ee1e9b72278a11393137934dbbce0aaa.jpg saved to cache
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05138d0>
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_996bc9055998c22e183b066755562018.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_996bc9055998c22e183b066755562018.jpg saved to cache
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e6590>
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_5f1829ab3afb375ac166d6ac58490ae4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_5f1829ab3afb375ac166d6ac58490ae4.jpg saved to cache
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae06344d0>
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_aa48b2956faf940d436fbfc085c66ed8.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_aa48b2956faf940d436fbfc085c66ed8.jpg saved to cache
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_e9f1a0da248d90c693cc8673f640f07a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e9f1a0da248d90c693cc8673f640f07a.jpg not downloaded yet
2025-12-05 20:01:57 [auto1.it] INFO: Found listing with ID: GM86600
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86600%27 HTTP/1.1" 200 None
2025-12-05 20:01:57 [auto1.it] INFO: Scrape type for GM86600: 0
2025-12-05 20:01:57 [auto1.it] INFO: Found listing with ID: NX67246
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX67246%27 HTTP/1.1" 200 None
2025-12-05 20:01:57 [auto1.it] INFO: Scrape type for NX67246: 2
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00cb0d0>
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_cbdc6ff3a5042a4008e0775c46e1f2d0.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_cbdc6ff3a5042a4008e0775c46e1f2d0.jpg saved to cache
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02292d0>
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_17fcc681546c9d6bc7de850152f41b89.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_17fcc681546c9d6bc7de850152f41b89.jpg saved to cache
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9904be-6354-57cc-a706-9649e982ee13 with identifier: HL50165
2025-12-05 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9904be-6354-57cc-a706-9649e982ee13 with scrape type 2
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b9904be-6354-57cc-a706-9649e982ee13 with scrape type 2
2025-12-05 20:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b9904be-6354-57cc-a706-9649e982ee13, identifier: HL50165
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_7a12b741a0d279599080c3e578e550b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_38622880a87794eaaedfcbb3c4a615af.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_251a2d3dba150a9d083b4c2f7e288367.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_251a2d3dba150a9d083b4c2f7e288367.jpg not downloaded yet
2025-12-05 20:01:58 [auto1.it] INFO: Found listing with ID: RX96026
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX96026%27 HTTP/1.1" 200 None
2025-12-05 20:01:58 [auto1.it] INFO: Scrape type for RX96026: 0
2025-12-05 20:01:58 [auto1.it] INFO: Found listing with ID: NF87489
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87489%27 HTTP/1.1" 200 None
2025-12-05 20:01:58 [auto1.it] INFO: Scrape type for NF87489: 2
2025-12-05 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b9904be-6354-57cc-a706-9649e982ee13 with identifier: HL50165
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2025-12-05 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b9904be-6354-57cc-a706-9649e982ee13 with identifier: HL50165
2025-12-05 20:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b9904be-6354-57cc-a706-9649e982ee13 with identifier: HL50165 to the API
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL50165>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:56:40Z',
 'fuel_type': 'petrol',
 'id': '8b9904be-6354-57cc-a706-9649e982ee13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL50165',
 'listing': 'auction',
 'location': 'Modugno',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 75051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop hatchback',
 'transmission': 'manual',
 'trim': 'Pop hatchback',
 'year': 2018}
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL50165%27 HTTP/1.1" 200 None
2025-12-05 20:01:59 [auto1.it] INFO: Saving data for HL50165: {'auction_closing_time': 1765040200.0, 'created_time': 1764878463.929931, 'last_price_update_time': 1764964919.276568}
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL50165') HTTP/1.1" 204 0
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_401965799cf4f5ef5a97099b7f3035b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_401965799cf4f5ef5a97099b7f3035b8.jpg not downloaded yet
2025-12-05 20:01:59 [auto1.it] INFO: Found listing with ID: ED89256
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED89256%27 HTTP/1.1" 200 None
2025-12-05 20:01:59 [auto1.it] INFO: Scrape type for ED89256: 2
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC91200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD37557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA01461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL77608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP22831> (referer: https://www.auto1.com/v1/car-details-view/MP22831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_b95846e222d1f083b0b4c9558ce56dd9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_2efb206941a98a19f560f211a04bcdfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_2efb206941a98a19f560f211a04bcdfa.jpg not downloaded yet
2025-12-05 20:01:59 [auto1.it] INFO: Found listing with ID: UB43955
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB43955%27 HTTP/1.1" 200 None
2025-12-05 20:01:59 [auto1.it] INFO: Scrape type for UB43955: 0
2025-12-05 20:01:59 [auto1.it] INFO: Found listing with ID: GZ35753
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ35753%27 HTTP/1.1" 200 None
2025-12-05 20:01:59 [auto1.it] INFO: Scrape type for GZ35753: 2
2025-12-05 20:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0346f10>
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_7a12b741a0d279599080c3e578e550b5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_7a12b741a0d279599080c3e578e550b5.jpg saved to cache
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0479810>
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_38622880a87794eaaedfcbb3c4a615af.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_38622880a87794eaaedfcbb3c4a615af.jpg saved to cache
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e9f1a0da248d90c693cc8673f640f07a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_3e5dabc5fa6eb4a8b406e2bea8ea6ca7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_3e5dabc5fa6eb4a8b406e2bea8ea6ca7.jpg not downloaded yet
2025-12-05 20:02:00 [auto1.it] INFO: Found listing with ID: WU37931
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU37931%27 HTTP/1.1" 200 None
2025-12-05 20:02:00 [auto1.it] INFO: Scrape type for WU37931: 0
2025-12-05 20:02:00 [auto1.it] INFO: Found listing with ID: XS04727
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS04727%27 HTTP/1.1" 200 None
2025-12-05 20:02:00 [auto1.it] INFO: Scrape type for XS04727: 0
2025-12-05 20:02:00 [auto1.it] INFO: Found listing with ID: RY32891
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY32891%27 HTTP/1.1" 200 None
2025-12-05 20:02:00 [auto1.it] INFO: Scrape type for RY32891: 0
2025-12-05 20:02:00 [auto1.it] INFO: Found listing with ID: JE07333
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE07333%27 HTTP/1.1" 200 None
2025-12-05 20:02:00 [auto1.it] INFO: Scrape type for JE07333: 1
2025-12-05 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU84869> (referer: https://www.auto1.com/v1/car-details-view/GU84869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_a64ebada72dd5e651b88e67afcb183aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_a64ebada72dd5e651b88e67afcb183aa.jpg not downloaded yet
2025-12-05 20:02:00 [auto1.it] INFO: Found listing with ID: UA54226
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54226%27 HTTP/1.1" 200 None
2025-12-05 20:02:00 [auto1.it] INFO: Scrape type for UA54226: 2
2025-12-05 20:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:00 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f with identifier: MP22831
2025-12-05 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f with scrape type 2
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f with scrape type 2
2025-12-05 20:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f, identifier: MP22831
2025-12-05 20:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f0d10>
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_b95846e222d1f083b0b4c9558ce56dd9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_b95846e222d1f083b0b4c9558ce56dd9.jpg saved to cache
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f with identifier: MP22831
2025-12-05 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f with identifier: MP22831
2025-12-05 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164181
2025-12-05 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f spider: auto1.it
2025-12-05 20:02:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f due to rule: high_mileage_for_country.json, error: 164181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164181
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:20:28Z',
 'fuel_type': 'diesel',
 'id': '39f0c3e5-1e3a-536c-9e09-e8b2590c8f9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP22831',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 164181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP22831%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Saving data for MP22831: {'auction_closing_time': 1765038028.0, 'created_time': 1764878433.86189, 'last_price_update_time': 1764964921.444748}
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP22831') HTTP/1.1" 204 0
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_7da8f6ac15881b64908787c2b02f2115.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7da8f6ac15881b64908787c2b02f2115.jpg not downloaded yet
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: LG42514
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG42514%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for LG42514: 0
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: GJ74171
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ74171%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for GJ74171: 0
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: VJ87382
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ87382%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for VJ87382: 0
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: UA54373
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for UA54373: 2
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: HU53329
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53329%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for HU53329: 0
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: SH46646
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH46646%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for SH46646: 0
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: XK22503
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK22503%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for XK22503: 0
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: PF55031
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF55031%27 HTTP/1.1" 200 None
2025-12-05 20:02:01 [auto1.it] INFO: Scrape type for PF55031: 0
2025-12-05 20:02:01 [auto1.it] INFO: Found listing with ID: LE73930
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE73930%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for LE73930: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: VK07610
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for VK07610: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: EL05758
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05758%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for EL05758: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: YR95481
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR95481%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for YR95481: 2
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007e990>
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_e9f1a0da248d90c693cc8673f640f07a.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e9f1a0da248d90c693cc8673f640f07a.jpg saved to cache
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_401965799cf4f5ef5a97099b7f3035b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7eef41de2841b6fccb570357719ebcdb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: MU47975
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47975%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for MU47975: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: RD01176
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01176%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for RD01176: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: UH13472
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH13472%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for UH13472: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: RT83017
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT83017%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for RT83017: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: LZ55046
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ55046%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for LZ55046: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: NF45221
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF45221%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for NF45221: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: TF56529
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF56529%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for TF56529: 2
2025-12-05 20:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 630063e8-f765-510e-9920-98c67d0f23dc with identifier: GU84869
2025-12-05 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630063e8-f765-510e-9920-98c67d0f23dc with scrape type 2
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 630063e8-f765-510e-9920-98c67d0f23dc with scrape type 2
2025-12-05 20:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 630063e8-f765-510e-9920-98c67d0f23dc, identifier: GU84869
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: ZS31369
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS31369%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for ZS31369: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: TH40683
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH40683%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for TH40683: 0
2025-12-05 20:02:02 [auto1.it] INFO: Found listing with ID: UE72623
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE72623%27 HTTP/1.1" 200 None
2025-12-05 20:02:02 [auto1.it] INFO: Scrape type for UE72623: 1
2025-12-05 20:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 630063e8-f765-510e-9920-98c67d0f23dc with identifier: GU84869
2025-12-05 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 630063e8-f765-510e-9920-98c67d0f23dc with identifier: GU84869
2025-12-05 20:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 630063e8-f765-510e-9920-98c67d0f23dc with identifier: GU84869 to the API
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GU84869>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:32:45Z',
 'fuel_type': 'petrol',
 'id': '630063e8-f765-510e-9920-98c67d0f23dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU84869',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 127305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU84869%27 HTTP/1.1" 200 None
2025-12-05 20:02:03 [auto1.it] INFO: Saving data for GU84869: {'auction_closing_time': 1765038765.0, 'created_time': 1764878438.238584, 'last_price_update_time': 1764964923.335258}
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU84869') HTTP/1.1" 204 0
2025-12-05 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_bf8807e99bc810d1ca49084f27c8a17b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae2342e50>
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_401965799cf4f5ef5a97099b7f3035b8.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_401965799cf4f5ef5a97099b7f3035b8.jpg saved to cache
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05cfbd0>
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_7eef41de2841b6fccb570357719ebcdb.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7eef41de2841b6fccb570357719ebcdb.jpg saved to cache
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: VV30676
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV30676%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for VV30676: 2
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK82687/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE07333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA69794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX67246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: SH03361
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH03361%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for SH03361: 0
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: CH47272
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH47272%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for CH47272: 0
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: CZ27491
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ27491%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for CZ27491: 1
2025-12-05 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ35753/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03aa9d0>
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_bf8807e99bc810d1ca49084f27c8a17b.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_bf8807e99bc810d1ca49084f27c8a17b.jpg saved to cache
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: SN43915
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43915%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for SN43915: 2
2025-12-05 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF87489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: KW54153
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW54153%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for KW54153: 0
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: YS60698
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for YS60698: 0
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: ZC72396
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC72396%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for ZC72396: 0
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: TW27290
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW27290%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for TW27290: 2
2025-12-05 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW19272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: RU07739
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU07739%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for RU07739: 2
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: DU87329
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU87329%27 HTTP/1.1" 200 None
2025-12-05 20:02:04 [auto1.it] INFO: Scrape type for DU87329: 2
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7da8f6ac15881b64908787c2b02f2115.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:04 [auto1.it] INFO: Found listing with ID: BT06439
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT06439%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for BT06439: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: CC80273
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC80273%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for CC80273: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: YK03588
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK03588%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for YK03588: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: DV77593
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV77593%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for DV77593: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: SU51578
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU51578%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for SU51578: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: NF58021
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF58021%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for NF58021: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: XB39028
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB39028%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for XB39028: 2
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: PH80137
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH80137%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for PH80137: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: DK20818
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK20818%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for DK20818: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: LJ59063
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ59063%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for LJ59063: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: PD39059
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD39059%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for PD39059: 2
2025-12-05 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED89256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: NF03892
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF03892%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for NF03892: 2
2025-12-05 20:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00af690>
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_7da8f6ac15881b64908787c2b02f2115.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7da8f6ac15881b64908787c2b02f2115.jpg saved to cache
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: ZE06334
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE06334%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for ZE06334: 2
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: PV10123
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV10123%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for PV10123: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: MT07045
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT07045%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for MT07045: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: NC36424
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC36424%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for NC36424: 0
2025-12-05 20:02:05 [auto1.it] INFO: Found listing with ID: BN56520
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN56520%27 HTTP/1.1" 200 None
2025-12-05 20:02:05 [auto1.it] INFO: Scrape type for BN56520: 0
2025-12-05 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e824f03084b4fe31c2a64382fc1904e7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_5600f83afbf25872a03ea838343f1448.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_adbc740a597cc45cac61aa19addddcdb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_251a2d3dba150a9d083b4c2f7e288367.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_2efb206941a98a19f560f211a04bcdfa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04f4110>
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_e824f03084b4fe31c2a64382fc1904e7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e824f03084b4fe31c2a64382fc1904e7.jpg saved to cache
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae5284d90>
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_5600f83afbf25872a03ea838343f1448.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_5600f83afbf25872a03ea838343f1448.jpg saved to cache
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL77608> (referer: https://www.auto1.com/v1/car-details-view/LL77608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV30676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR95481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA54373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN43915/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE72623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ27491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0636850>
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_adbc740a597cc45cac61aa19addddcdb.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_adbc740a597cc45cac61aa19addddcdb.jpg saved to cache
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05ca810>
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_251a2d3dba150a9d083b4c2f7e288367.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_251a2d3dba150a9d083b4c2f7e288367.jpg saved to cache
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0603ad0>
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_2efb206941a98a19f560f211a04bcdfa.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_2efb206941a98a19f560f211a04bcdfa.jpg saved to cache
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0f8a8f-819d-54b4-b0f0-cf945f6dc466 with identifier: LL77608
2025-12-05 20:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0f8a8f-819d-54b4-b0f0-cf945f6dc466 with scrape type 2
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c0f8a8f-819d-54b4-b0f0-cf945f6dc466 with scrape type 2
2025-12-05 20:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c0f8a8f-819d-54b4-b0f0-cf945f6dc466, identifier: LL77608
2025-12-05 20:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c0f8a8f-819d-54b4-b0f0-cf945f6dc466 with identifier: LL77608
2025-12-05 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c0f8a8f-819d-54b4-b0f0-cf945f6dc466 with identifier: LL77608
2025-12-05 20:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c0f8a8f-819d-54b4-b0f0-cf945f6dc466 with identifier: LL77608 to the API
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LL77608>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:42:51Z',
 'fuel_type': 'diesel',
 'id': '9c0f8a8f-819d-54b4-b0f0-cf945f6dc466',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL77608',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 100375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE Luxury',
 'transmission': 'automatic',
 'trim': 'HSE Luxury',
 'year': 2019}
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL77608%27 HTTP/1.1" 200 None
2025-12-05 20:02:08 [auto1.it] INFO: Saving data for LL77608: {'auction_closing_time': 1765039371.0, 'created_time': 1764360039.851665, 'last_price_update_time': 1764964928.885772}
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LL77608') HTTP/1.1" 204 0
2025-12-05 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW27290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF87489> (referer: https://www.auto1.com/v1/car-details-view/NF87489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF03892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c63cbf-0980-5d54-b70d-883f6a9e96ee with identifier: NF87489
2025-12-05 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c63cbf-0980-5d54-b70d-883f6a9e96ee with scrape type 2
2025-12-05 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46c63cbf-0980-5d54-b70d-883f6a9e96ee with scrape type 2
2025-12-05 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46c63cbf-0980-5d54-b70d-883f6a9e96ee, identifier: NF87489
2025-12-05 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46c63cbf-0980-5d54-b70d-883f6a9e96ee with identifier: NF87489
2025-12-05 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46c63cbf-0980-5d54-b70d-883f6a9e96ee with identifier: NF87489
2025-12-05 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46c63cbf-0980-5d54-b70d-883f6a9e96ee with identifier: NF87489 to the API
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF87489>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2025-12-06T16:06:33Z',
 'fuel_type': 'hybrid',
 'id': '46c63cbf-0980-5d54-b70d-883f6a9e96ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF87489',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 47246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2022}
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87489%27 HTTP/1.1" 200 None
2025-12-05 20:02:10 [auto1.it] INFO: Saving data for NF87489: {'auction_closing_time': 1765037193.0, 'created_time': 1764015084.32649, 'last_price_update_time': 1764964930.418696}
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF87489') HTTP/1.1" 204 0
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD39059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB39028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW19272> (referer: https://www.auto1.com/v1/car-details-view/WW19272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED89256> (referer: https://www.auto1.com/v1/car-details-view/ED89256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE06334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3fbd2b5-a3cb-541e-b2bb-7c672ad71607 with identifier: WW19272
2025-12-05 20:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3fbd2b5-a3cb-541e-b2bb-7c672ad71607 with scrape type 2
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3fbd2b5-a3cb-541e-b2bb-7c672ad71607 with scrape type 2
2025-12-05 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3fbd2b5-a3cb-541e-b2bb-7c672ad71607, identifier: WW19272
2025-12-05 20:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c51f0c-f7e3-5464-bbdb-54cce0d0b332 with identifier: ED89256
2025-12-05 20:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c51f0c-f7e3-5464-bbdb-54cce0d0b332 with scrape type 2
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c51f0c-f7e3-5464-bbdb-54cce0d0b332 with scrape type 2
2025-12-05 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16c51f0c-f7e3-5464-bbdb-54cce0d0b332, identifier: ED89256
2025-12-05 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3fbd2b5-a3cb-541e-b2bb-7c672ad71607 with identifier: WW19272
2025-12-05 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3fbd2b5-a3cb-541e-b2bb-7c672ad71607 with identifier: WW19272
2025-12-05 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3fbd2b5-a3cb-541e-b2bb-7c672ad71607 with identifier: WW19272 to the API
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW19272>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:11:50Z',
 'fuel_type': 'petrol',
 'id': 'c3fbd2b5-a3cb-541e-b2bb-7c672ad71607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW19272',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 36191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2017}
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW19272%27 HTTP/1.1" 200 None
2025-12-05 20:02:11 [auto1.it] INFO: Saving data for WW19272: {'auction_closing_time': 1765037510.0, 'created_time': 1763409784.178595, 'last_price_update_time': 1764964931.239799}
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW19272') HTTP/1.1" 204 0
2025-12-05 20:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16c51f0c-f7e3-5464-bbdb-54cce0d0b332 with identifier: ED89256
2025-12-05 20:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16c51f0c-f7e3-5464-bbdb-54cce0d0b332 with identifier: ED89256
2025-12-05 20:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16c51f0c-f7e3-5464-bbdb-54cce0d0b332 with identifier: ED89256 to the API
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED89256>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:54:31Z',
 'fuel_type': 'petrol',
 'id': '16c51f0c-f7e3-5464-bbdb-54cce0d0b332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED89256',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 84801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED89256%27 HTTP/1.1" 200 None
2025-12-05 20:02:11 [auto1.it] INFO: Saving data for ED89256: {'auction_closing_time': 1765040071.0, 'created_time': 1762805051.459556, 'last_price_update_time': 1764964931.617387}
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED89256') HTTP/1.1" 204 0
2025-12-05 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF56529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU87329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU07739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ35753> (referer: https://www.auto1.com/v1/car-details-view/GZ35753/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK82687> (referer: https://www.auto1.com/v1/car-details-view/VK82687/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA69794> (referer: https://www.auto1.com/v1/car-details-view/SA69794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda75a92-3d27-5a18-b4a2-7a7a4e636676 with identifier: GZ35753
2025-12-05 20:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda75a92-3d27-5a18-b4a2-7a7a4e636676 with scrape type 2
2025-12-05 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda75a92-3d27-5a18-b4a2-7a7a4e636676 with scrape type 2
2025-12-05 20:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fda75a92-3d27-5a18-b4a2-7a7a4e636676, identifier: GZ35753
2025-12-05 20:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fda75a92-3d27-5a18-b4a2-7a7a4e636676 with identifier: GZ35753
2025-12-05 20:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fda75a92-3d27-5a18-b4a2-7a7a4e636676 with identifier: GZ35753
2025-12-05 20:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fda75a92-3d27-5a18-b4a2-7a7a4e636676 with identifier: GZ35753 to the API
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ35753>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 200,
 'expiration_date': '2025-12-06T16:37:11Z',
 'fuel_type': 'hybrid',
 'id': 'fda75a92-3d27-5a18-b4a2-7a7a4e636676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ35753',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Renault',
 'model': 'Austral',
 'odometer': 12192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Austral 1.2 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ35753%27 HTTP/1.1" 200 None
2025-12-05 20:02:12 [auto1.it] INFO: Saving data for GZ35753: {'auction_closing_time': 1765039031.0, 'created_time': 1762372943.09126, 'last_price_update_time': 1764964932.978686}
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ35753') HTTP/1.1" 204 0
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ27491> (referer: https://www.auto1.com/v1/car-details-view/CZ27491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX67246> (referer: https://www.auto1.com/v1/car-details-view/NX67246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE07333> (referer: https://www.auto1.com/v1/car-details-view/JE07333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d07aee6d-18ba-5963-b602-f4eb11818c7b with identifier: VK82687
2025-12-05 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d07aee6d-18ba-5963-b602-f4eb11818c7b with scrape type 2
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d07aee6d-18ba-5963-b602-f4eb11818c7b with scrape type 2
2025-12-05 20:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d07aee6d-18ba-5963-b602-f4eb11818c7b, identifier: VK82687
2025-12-05 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11c57f55-9dd1-5804-8a99-caa90b040f3e with identifier: SA69794
2025-12-05 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11c57f55-9dd1-5804-8a99-caa90b040f3e with scrape type 2
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11c57f55-9dd1-5804-8a99-caa90b040f3e with scrape type 2
2025-12-05 20:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 11c57f55-9dd1-5804-8a99-caa90b040f3e, identifier: SA69794
2025-12-05 20:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d07aee6d-18ba-5963-b602-f4eb11818c7b with identifier: VK82687
2025-12-05 20:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d07aee6d-18ba-5963-b602-f4eb11818c7b with identifier: VK82687
2025-12-05 20:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d07aee6d-18ba-5963-b602-f4eb11818c7b with identifier: VK82687 to the API
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VK82687>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:04:48Z',
 'fuel_type': 'hybrid',
 'id': 'd07aee6d-18ba-5963-b602-f4eb11818c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK82687',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 35210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Exellence 2WD',
 'transmission': 'automatic',
 'trim': 'Exellence 2WD',
 'year': 2021}
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK82687%27 HTTP/1.1" 200 None
2025-12-05 20:02:13 [auto1.it] INFO: Saving data for VK82687: {'auction_closing_time': 1765037088.0, 'created_time': 1764878431.571278, 'last_price_update_time': 1764964933.591137}
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK82687') HTTP/1.1" 204 0
2025-12-05 20:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 11c57f55-9dd1-5804-8a99-caa90b040f3e with identifier: SA69794
2025-12-05 20:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 11c57f55-9dd1-5804-8a99-caa90b040f3e with identifier: SA69794
2025-12-05 20:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156651 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156651
2025-12-05 20:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 11c57f55-9dd1-5804-8a99-caa90b040f3e spider: auto1.it
2025-12-05 20:02:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 11c57f55-9dd1-5804-8a99-caa90b040f3e due to rule: high_mileage_for_country.json, error: 156651 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156651
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 355,
 'expiration_date': '2025-12-06T16:33:32Z',
 'fuel_type': 'petrol',
 'id': '11c57f55-9dd1-5804-8a99-caa90b040f3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA69794',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Audi',
 'model': 'S4',
 'odometer': 156651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S4 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA69794%27 HTTP/1.1" 200 None
2025-12-05 20:02:13 [auto1.it] INFO: Saving data for SA69794: {'auction_closing_time': 1765038812.0, 'created_time': 1764878439.543977, 'last_price_update_time': 1764964933.841878}
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SA69794') HTTP/1.1" 204 0
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE72623> (referer: https://www.auto1.com/v1/car-details-view/UE72623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW27290> (referer: https://www.auto1.com/v1/car-details-view/TW27290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491
2025-12-05 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e with scrape type 1
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a2f0b1f7ae0e23ab981bb43f790dc0cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a2f0b1f7ae0e23ab981bb43f790dc0cd.jpg not downloaded yet
2025-12-05 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c287744-9867-58ad-9dc6-6868b219940e with identifier: NX67246
2025-12-05 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c287744-9867-58ad-9dc6-6868b219940e with scrape type 2
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c287744-9867-58ad-9dc6-6868b219940e with scrape type 2
2025-12-05 20:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c287744-9867-58ad-9dc6-6868b219940e, identifier: NX67246
2025-12-05 20:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a5c7e6a-6af2-5742-9d98-76c25d869114 with identifier: JE07333
2025-12-05 20:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a5c7e6a-6af2-5742-9d98-76c25d869114 with scrape type 1
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 6a5c7e6a-6af2-5742-9d98-76c25d869114
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_86910dd5722bdea0155ca4d1c3a96e5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_86910dd5722bdea0155ca4d1c3a96e5b.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_fbccb004f66b1903dade9c708bda818f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fbccb004f66b1903dade9c708bda818f.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_637a8271c5b4612c90d22c38faae4fb7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_637a8271c5b4612c90d22c38faae4fb7.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_fe1eb0fe6d95c0ec8abb4596f82726f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fe1eb0fe6d95c0ec8abb4596f82726f6.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_6e5c92533248a3f133fa9e0ed7207a40.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_6e5c92533248a3f133fa9e0ed7207a40.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_858ba0d1bee41f0e4c409f89c4ab5834.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_858ba0d1bee41f0e4c409f89c4ab5834.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_47b67ffa36b2591b42705912bdf13826.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_47b67ffa36b2591b42705912bdf13826.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_3b903af35ee1f91cf085dee10e17bf1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_3b903af35ee1f91cf085dee10e17bf1d.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_8450472903b34548af5d7dc00ac4f639.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_8450472903b34548af5d7dc00ac4f639.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_47b6e12820a3874e3f92d1ba975c61a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_47b6e12820a3874e3f92d1ba975c61a5.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_fdc8920b72385b0845864401b148484e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fdc8920b72385b0845864401b148484e.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_b2b4160ef0b4bf5ce3d697e5343f90d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_b2b4160ef0b4bf5ce3d697e5343f90d1.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_85ccb2ab16dace889496e9562112be7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_85ccb2ab16dace889496e9562112be7e.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_92b950abca6b32cc7bad7a435f3da2a3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_92b950abca6b32cc7bad7a435f3da2a3.jpg already downloaded
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb8%252F89b825ca83d7014625ed7298aa59135f%252Fpa%252FJE07333_7ed924044e55674776f63513ce8f7487.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_7ed924044e55674776f63513ce8f7487.jpg already downloaded
2025-12-05 20:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a5c7e6a-6af2-5742-9d98-76c25d869114, identifier: JE07333
2025-12-05 20:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c287744-9867-58ad-9dc6-6868b219940e with identifier: NX67246
2025-12-05 20:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c287744-9867-58ad-9dc6-6868b219940e with identifier: NX67246
2025-12-05 20:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c287744-9867-58ad-9dc6-6868b219940e with identifier: NX67246 to the API
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX67246>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2025-12-06T16:04:53Z',
 'fuel_type': 'petrol',
 'id': '8c287744-9867-58ad-9dc6-6868b219940e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX67246',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 90407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman John Cooper Works ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2020}
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX67246%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [auto1.it] INFO: Saving data for NX67246: {'auction_closing_time': 1765037093.0, 'created_time': 1763064200.061802, 'last_price_update_time': 1764964935.009361}
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NX67246') HTTP/1.1" 204 0
2025-12-05 20:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a5c7e6a-6af2-5742-9d98-76c25d869114 with identifier: JE07333
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a5c7e6a-6af2-5742-9d98-76c25d869114 with identifier: JE07333
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137862 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137862
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 6a5c7e6a-6af2-5742-9d98-76c25d869114 spider: auto1.it
2025-12-05 20:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 6a5c7e6a-6af2-5742-9d98-76c25d869114 due to rule: high_mileage_for_make.json, error: 137862 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137862
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:56:15Z',
 'fuel_type': 'diesel',
 'id': '6a5c7e6a-6af2-5742-9d98-76c25d869114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE07333',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 137862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_86910dd5722bdea0155ca4d1c3a96e5b.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fbccb004f66b1903dade9c708bda818f.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_637a8271c5b4612c90d22c38faae4fb7.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fe1eb0fe6d95c0ec8abb4596f82726f6.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_6e5c92533248a3f133fa9e0ed7207a40.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_858ba0d1bee41f0e4c409f89c4ab5834.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_47b67ffa36b2591b42705912bdf13826.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_3b903af35ee1f91cf085dee10e17bf1d.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_8450472903b34548af5d7dc00ac4f639.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_47b6e12820a3874e3f92d1ba975c61a5.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fdc8920b72385b0845864401b148484e.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_b2b4160ef0b4bf5ce3d697e5343f90d1.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_85ccb2ab16dace889496e9562112be7e.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_92b950abca6b32cc7bad7a435f3da2a3.jpg',
                'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_7ed924044e55674776f63513ce8f7487.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_86910dd5722bdea0155ca4d1c3a96e5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fbccb004f66b1903dade9c708bda818f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_637a8271c5b4612c90d22c38faae4fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fe1eb0fe6d95c0ec8abb4596f82726f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_6e5c92533248a3f133fa9e0ed7207a40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_858ba0d1bee41f0e4c409f89c4ab5834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_47b67ffa36b2591b42705912bdf13826.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_3b903af35ee1f91cf085dee10e17bf1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_8450472903b34548af5d7dc00ac4f639.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_47b6e12820a3874e3f92d1ba975c61a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_fdc8920b72385b0845864401b148484e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_b2b4160ef0b4bf5ce3d697e5343f90d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_85ccb2ab16dace889496e9562112be7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_92b950abca6b32cc7bad7a435f3da2a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5c7e6a-6af2-5742-9d98-76c25d869114/6a5c7e6a-6af2-5742-9d98-76c25d869114_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b8/89b825ca83d7014625ed7298aa59135f/pa/JE07333_7ed924044e55674776f63513ce8f7487.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2018}
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE07333%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [auto1.it] INFO: Saving data for JE07333: {'created_time': 1764964935.311587, 'last_price_update_time': 1764964935.311599, 'auction_closing_time': 1765040175.0}
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE07333') HTTP/1.1" 204 0
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a8aa715269e99d3847008fa5722176f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a8aa715269e99d3847008fa5722176f6.jpg not downloaded yet
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN43915> (referer: https://www.auto1.com/v1/car-details-view/SN43915/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR95481> (referer: https://www.auto1.com/v1/car-details-view/YR95481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA54373> (referer: https://www.auto1.com/v1/car-details-view/UA54373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a89ea37b643db2d38ff959c9c9c47110.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a89ea37b643db2d38ff959c9c9c47110.jpg not downloaded yet
2025-12-05 20:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c7aa68-5512-5453-aaa3-0ec2aefaa167 with identifier: UE72623
2025-12-05 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167 with scrape type 1
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_78836ffac278b4674f9e3baee8566b77.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_78836ffac278b4674f9e3baee8566b77.jpg not downloaded yet
2025-12-05 20:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71208c26-0808-5c76-a73d-a0cc8762fc7f with identifier: TW27290
2025-12-05 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71208c26-0808-5c76-a73d-a0cc8762fc7f with scrape type 2
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71208c26-0808-5c76-a73d-a0cc8762fc7f with scrape type 2
2025-12-05 20:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71208c26-0808-5c76-a73d-a0cc8762fc7f, identifier: TW27290
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_70713c0303bd1fc5570c89b371d9b15a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_70713c0303bd1fc5570c89b371d9b15a.jpg not downloaded yet
2025-12-05 20:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71208c26-0808-5c76-a73d-a0cc8762fc7f with identifier: TW27290
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71208c26-0808-5c76-a73d-a0cc8762fc7f with identifier: TW27290
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178272 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178272
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 71208c26-0808-5c76-a73d-a0cc8762fc7f spider: auto1.it
2025-12-05 20:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 71208c26-0808-5c76-a73d-a0cc8762fc7f due to rule: high_mileage_for_country.json, error: 178272 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178272
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:33:26Z',
 'fuel_type': 'diesel',
 'id': '71208c26-0808-5c76-a73d-a0cc8762fc7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW27290',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 178272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 DDiS Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2018}
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW27290%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [auto1.it] INFO: Saving data for TW27290: {'auction_closing_time': 1765038806.0, 'created_time': 1763496372.564908, 'last_price_update_time': 1764964935.782197}
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW27290') HTTP/1.1" 204 0
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_8832892d05d69ee53c792a5d41c75704.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_8832892d05d69ee53c792a5d41c75704.jpg not downloaded yet
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_e13c7e4a9a1ea0c040e33da2a1934620.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e13c7e4a9a1ea0c040e33da2a1934620.jpg not downloaded yet
2025-12-05 20:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349b7671-c83c-5ca0-a12f-0abc61183748 with identifier: SN43915
2025-12-05 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349b7671-c83c-5ca0-a12f-0abc61183748 with scrape type 2
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349b7671-c83c-5ca0-a12f-0abc61183748 with scrape type 2
2025-12-05 20:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 349b7671-c83c-5ca0-a12f-0abc61183748, identifier: SN43915
2025-12-05 20:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481
2025-12-05 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69459ae1-63a7-5afa-b36b-0c4eb39acdae with scrape type 2
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69459ae1-63a7-5afa-b36b-0c4eb39acdae with scrape type 2
2025-12-05 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69459ae1-63a7-5afa-b36b-0c4eb39acdae, identifier: YR95481
2025-12-05 20:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373
2025-12-05 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b873199b-b674-58c3-9642-d8f715c5f2d5 with scrape type 2
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b873199b-b674-58c3-9642-d8f715c5f2d5 with scrape type 2
2025-12-05 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b873199b-b674-58c3-9642-d8f715c5f2d5, identifier: UA54373
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_63f821812d0821871d185f4c86155e8e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_63f821812d0821871d185f4c86155e8e.jpg not downloaded yet
2025-12-05 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 349b7671-c83c-5ca0-a12f-0abc61183748 with identifier: SN43915
2025-12-05 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 349b7671-c83c-5ca0-a12f-0abc61183748 with identifier: SN43915
2025-12-05 20:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 349b7671-c83c-5ca0-a12f-0abc61183748 with identifier: SN43915 to the API
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN43915>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:22:44Z',
 'fuel_type': 'diesel',
 'id': '349b7671-c83c-5ca0-a12f-0abc61183748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN43915',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 131572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2017}
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43915%27 HTTP/1.1" 200 None
2025-12-05 20:02:16 [auto1.it] INFO: Saving data for SN43915: {'auction_closing_time': 1765038164.0, 'created_time': 1762941663.675615, 'last_price_update_time': 1764964936.600582}
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN43915') HTTP/1.1" 204 0
2025-12-05 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481
2025-12-05 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481
2025-12-05 20:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481 to the API
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YR95481>
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.2L',
 'engine_horse_power': 177,
 'expiration_date': '2025-12-06T16:54:07Z',
 'fuel_type': 'diesel',
 'id': '69459ae1-63a7-5afa-b36b-0c4eb39acdae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR95481',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Hyundai',
 'model': 'Staria',
 'odometer': 33298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Hyundai Staria 2.2 CRDi Signature 2WD',
 'transmission': 'automatic',
 'trim': 'Signature 2WD',
 'year': 2022}
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR95481%27 HTTP/1.1" 200 None
2025-12-05 20:02:16 [auto1.it] INFO: Saving data for YR95481: {'auction_closing_time': 1765040047.0, 'created_time': 1763582655.865932, 'last_price_update_time': 1764964936.981925}
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR95481') HTTP/1.1" 204 0
2025-12-05 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373
2025-12-05 20:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b873199b-b674-58c3-9642-d8f715c5f2d5 with identifier: UA54373 to the API
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA54373>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:32:05Z',
 'fuel_type': 'petrol',
 'id': 'b873199b-b674-58c3-9642-d8f715c5f2d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA54373',
 'listing': 'auction',
 'location': 'IT, Cagliari',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 51614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [auto1.it] INFO: Saving data for UA54373: {'auction_closing_time': 1765038725.0, 'created_time': 1764756191.959352, 'last_price_update_time': 1764964937.596419}
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA54373') HTTP/1.1" 204 0
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a8aa715269e99d3847008fa5722176f6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_a64ebada72dd5e651b88e67afcb183aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_6c66901c509f61f7e34703a99fd80ebe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_6c66901c509f61f7e34703a99fd80ebe.jpg not downloaded yet
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_84ae3cbffbba21da103b89b0783cdf77.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_84ae3cbffbba21da103b89b0783cdf77.jpg not downloaded yet
2025-12-05 20:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU87329> (referer: https://www.auto1.com/v1/car-details-view/DU87329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF56529> (referer: https://www.auto1.com/v1/car-details-view/TF56529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV30676> (referer: https://www.auto1.com/v1/car-details-view/VV30676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE06334> (referer: https://www.auto1.com/v1/car-details-view/ZE06334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_548703855aa511a511ee5d080a722196.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_548703855aa511a511ee5d080a722196.jpg not downloaded yet
2025-12-05 20:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_59b3e341de69dbb4d4d60a5c70861a03.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_59b3e341de69dbb4d4d60a5c70861a03.jpg not downloaded yet
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a9d90811abb35d1aeff683a99b33be8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a9d90811abb35d1aeff683a99b33be8f.jpg not downloaded yet
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_02f9b616495860ab47e20a6004f744ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_02f9b616495860ab47e20a6004f744ea.jpg not downloaded yet
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01ed510>
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a8aa715269e99d3847008fa5722176f6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a8aa715269e99d3847008fa5722176f6.jpg saved to cache
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0129ad0>
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_a64ebada72dd5e651b88e67afcb183aa.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_a64ebada72dd5e651b88e67afcb183aa.jpg saved to cache
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_92ee6c6fbb9c3563ec147cd836a86f0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_92ee6c6fbb9c3563ec147cd836a86f0a.jpg not downloaded yet
2025-12-05 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a89ea37b643db2d38ff959c9c9c47110.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_dcd800beed8c2d6b5f6511f4020dd3f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_dcd800beed8c2d6b5f6511f4020dd3f6.jpg not downloaded yet
2025-12-05 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_8832892d05d69ee53c792a5d41c75704.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_78836ffac278b4674f9e3baee8566b77.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_884c41be7ba4c8c46f75895133d939b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_884c41be7ba4c8c46f75895133d939b5.jpg not downloaded yet
2025-12-05 20:02:18 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b039c81-a82f-5e0b-a833-439c4c4b3924 with identifier: DU87329
2025-12-05 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b039c81-a82f-5e0b-a833-439c4c4b3924 with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b039c81-a82f-5e0b-a833-439c4c4b3924 with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b039c81-a82f-5e0b-a833-439c4c4b3924, identifier: DU87329
2025-12-05 20:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ebae53-5345-508a-b553-9ac466cece27 with identifier: TF56529
2025-12-05 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ebae53-5345-508a-b553-9ac466cece27 with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ebae53-5345-508a-b553-9ac466cece27 with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14ebae53-5345-508a-b553-9ac466cece27, identifier: TF56529
2025-12-05 20:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a with identifier: VV30676
2025-12-05 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc4ea46-5409-5b61-b6a5-9901462bc08a with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc4ea46-5409-5b61-b6a5-9901462bc08a with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9cc4ea46-5409-5b61-b6a5-9901462bc08a, identifier: VV30676
2025-12-05 20:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18 with identifier: ZE06334
2025-12-05 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18 with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18 with scrape type 2
2025-12-05 20:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18, identifier: ZE06334
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_2f0154d2e61c2c018a61804777424bf2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_2f0154d2e61c2c018a61804777424bf2.jpg not downloaded yet
2025-12-05 20:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b039c81-a82f-5e0b-a833-439c4c4b3924 with identifier: DU87329
2025-12-05 20:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b039c81-a82f-5e0b-a833-439c4c4b3924 with identifier: DU87329
2025-12-05 20:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b039c81-a82f-5e0b-a833-439c4c4b3924 with identifier: DU87329 to the API
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU87329>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 92,
 'expiration_date': '2025-12-06T16:03:49Z',
 'fuel_type': 'petrol',
 'id': '1b039c81-a82f-5e0b-a833-439c4c4b3924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU87329',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 38815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.0 IG-T Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2021}
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU87329%27 HTTP/1.1" 200 None
2025-12-05 20:02:19 [auto1.it] INFO: Saving data for DU87329: {'auction_closing_time': 1765037029.0, 'created_time': 1764014610.167516, 'last_price_update_time': 1764964939.313224}
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU87329') HTTP/1.1" 204 0
2025-12-05 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14ebae53-5345-508a-b553-9ac466cece27 with identifier: TF56529
2025-12-05 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14ebae53-5345-508a-b553-9ac466cece27 with identifier: TF56529
2025-12-05 20:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14ebae53-5345-508a-b553-9ac466cece27 with identifier: TF56529 to the API
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF56529>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:14:30Z',
 'fuel_type': 'petrol',
 'id': '14ebae53-5345-508a-b553-9ac466cece27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF56529',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 58298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF56529%27 HTTP/1.1" 200 None
2025-12-05 20:02:19 [auto1.it] INFO: Saving data for TF56529: {'auction_closing_time': 1765037670.0, 'created_time': 1763496507.294645, 'last_price_update_time': 1764964939.686534}
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF56529') HTTP/1.1" 204 0
2025-12-05 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a with identifier: VV30676
2025-12-05 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a with identifier: VV30676
2025-12-05 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178275 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178275
2025-12-05 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a spider: auto1.it
2025-12-05 20:02:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 9cc4ea46-5409-5b61-b6a5-9901462bc08a due to rule: high_mileage_for_country.json, error: 178275 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178275
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:47:04Z',
 'fuel_type': 'diesel',
 'id': '9cc4ea46-5409-5b61-b6a5-9901462bc08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV30676',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 178275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV30676%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Saving data for VV30676: {'auction_closing_time': 1765039624.0, 'created_time': 1763496365.675202, 'last_price_update_time': 1764964940.054682}
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV30676') HTTP/1.1" 204 0
2025-12-05 20:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18 with identifier: ZE06334
2025-12-05 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18 with identifier: ZE06334
2025-12-05 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150510 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150510
2025-12-05 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18 spider: auto1.it
2025-12-05 20:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18 due to rule: high_mileage_for_country.json, error: 150510 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150510
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:44:08Z',
 'fuel_type': 'diesel',
 'id': '5d64cb6f-9e5b-55fa-9e64-ffd46aa7ef18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE06334',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 150510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE06334%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Saving data for ZE06334: {'auction_closing_time': 1765039448.0, 'created_time': 1764360054.371125, 'last_price_update_time': 1764964940.312494}
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZE06334') HTTP/1.1" 204 0
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_ca42cd001556cf48291f1cd77fbe360f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_ca42cd001556cf48291f1cd77fbe360f.jpg not downloaded yet
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: YP57818
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP57818%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for YP57818: 0
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: HY00654
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY00654%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for HY00654: 0
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: KB87323
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB87323%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for KB87323: 0
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: YY50818
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY50818%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for YY50818: 0
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: XM98126
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for XM98126: 0
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: DF71090
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF71090%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for DF71090: 0
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: YJ69591
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ69591%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for YJ69591: 2
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_c06919da44a33bbd7edb2c4858f2e608.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_c06919da44a33bbd7edb2c4858f2e608.jpg not downloaded yet
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB39028> (referer: https://www.auto1.com/v1/car-details-view/XB39028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD39059> (referer: https://www.auto1.com/v1/car-details-view/PD39059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU07739> (referer: https://www.auto1.com/v1/car-details-view/RU07739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_63f821812d0821871d185f4c86155e8e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_92ee6c6fbb9c3563ec147cd836a86f0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a9d90811abb35d1aeff683a99b33be8f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_5f3960664e0914e5830ba1fdcad9add5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_5f3960664e0914e5830ba1fdcad9add5.jpg not downloaded yet
2025-12-05 20:02:20 [auto1.it] INFO: Found listing with ID: GE71060
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE71060%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [auto1.it] INFO: Scrape type for GE71060: 2
2025-12-05 20:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae008c950>
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a89ea37b643db2d38ff959c9c9c47110.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a89ea37b643db2d38ff959c9c9c47110.jpg saved to cache
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0144850>
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_8832892d05d69ee53c792a5d41c75704.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_8832892d05d69ee53c792a5d41c75704.jpg saved to cache
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae016dd10>
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_78836ffac278b4674f9e3baee8566b77.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_78836ffac278b4674f9e3baee8566b77.jpg saved to cache
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_d3148204373ad8598aceb98652caecdf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_d3148204373ad8598aceb98652caecdf.jpg not downloaded yet
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_e4e5fd45618206d85a4629976b93054d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e4e5fd45618206d85a4629976b93054d.jpg not downloaded yet
2025-12-05 20:02:21 [auto1.it] INFO: Found listing with ID: WH55073
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55073%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [auto1.it] INFO: Scrape type for WH55073: 0
2025-12-05 20:02:21 [auto1.it] INFO: Found listing with ID: FT49386
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT49386%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [auto1.it] INFO: Scrape type for FT49386: 2
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_4284a5758a885e58d29cb1df1e362b4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_4284a5758a885e58d29cb1df1e362b4c.jpg not downloaded yet
2025-12-05 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA01461> (referer: https://www.auto1.com/v1/car-details-view/UA01461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA54226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF03892> (referer: https://www.auto1.com/v1/car-details-view/NF03892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC91200> (referer: https://www.auto1.com/v1/car-details-view/LC91200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a8871a0-1bbd-5302-b48d-f158007de766 with identifier: XB39028
2025-12-05 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a8871a0-1bbd-5302-b48d-f158007de766 with scrape type 2
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a8871a0-1bbd-5302-b48d-f158007de766 with scrape type 2
2025-12-05 20:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a8871a0-1bbd-5302-b48d-f158007de766, identifier: XB39028
2025-12-05 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feffd50b-c24a-5ec7-a824-4ca249659d4c with identifier: PD39059
2025-12-05 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feffd50b-c24a-5ec7-a824-4ca249659d4c with scrape type 2
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feffd50b-c24a-5ec7-a824-4ca249659d4c with scrape type 2
2025-12-05 20:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: feffd50b-c24a-5ec7-a824-4ca249659d4c, identifier: PD39059
2025-12-05 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739
2025-12-05 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd948979-429a-5345-950d-a71727b89247 with scrape type 2
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd948979-429a-5345-950d-a71727b89247 with scrape type 2
2025-12-05 20:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd948979-429a-5345-950d-a71727b89247, identifier: RU07739
2025-12-05 20:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056d8d0>
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_63f821812d0821871d185f4c86155e8e.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_63f821812d0821871d185f4c86155e8e.jpg saved to cache
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00699d0>
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_92ee6c6fbb9c3563ec147cd836a86f0a.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_92ee6c6fbb9c3563ec147cd836a86f0a.jpg saved to cache
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05da210>
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a9d90811abb35d1aeff683a99b33be8f.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a9d90811abb35d1aeff683a99b33be8f.jpg saved to cache
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_02f9b616495860ab47e20a6004f744ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_c4b89b4eba1d460aeebd0750d123a5ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_c4b89b4eba1d460aeebd0750d123a5ba.jpg not downloaded yet
2025-12-05 20:02:23 [auto1.it] INFO: Found listing with ID: KX58847
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX58847%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [auto1.it] INFO: Scrape type for KX58847: 0
2025-12-05 20:02:23 [auto1.it] INFO: Found listing with ID: KH12738
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH12738%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [auto1.it] INFO: Scrape type for KH12738: 1
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD37557> (referer: https://www.auto1.com/v1/car-details-view/TD37557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a8871a0-1bbd-5302-b48d-f158007de766 with identifier: XB39028
2025-12-05 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a8871a0-1bbd-5302-b48d-f158007de766 with identifier: XB39028
2025-12-05 20:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a8871a0-1bbd-5302-b48d-f158007de766 with identifier: XB39028 to the API
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB39028>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:15:41Z',
 'fuel_type': 'diesel',
 'id': '5a8871a0-1bbd-5302-b48d-f158007de766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB39028',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 50454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB39028%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [auto1.it] INFO: Saving data for XB39028: {'auction_closing_time': 1765037741.0, 'created_time': 1763150430.658929, 'last_price_update_time': 1764964943.534521}
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XB39028') HTTP/1.1" 204 0
2025-12-05 20:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: feffd50b-c24a-5ec7-a824-4ca249659d4c with identifier: PD39059
2025-12-05 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: feffd50b-c24a-5ec7-a824-4ca249659d4c with identifier: PD39059
2025-12-05 20:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: feffd50b-c24a-5ec7-a824-4ca249659d4c with identifier: PD39059 to the API
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PD39059>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:53:59Z',
 'fuel_type': 'petrol',
 'id': 'feffd50b-c24a-5ec7-a824-4ca249659d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD39059',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 98210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2017}
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD39059%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [auto1.it] INFO: Saving data for PD39059: {'auction_closing_time': 1765040039.0, 'created_time': 1764360423.518152, 'last_price_update_time': 1764964944.034473}
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD39059') HTTP/1.1" 204 0
2025-12-05 20:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739
2025-12-05 20:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739
2025-12-05 20:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739 to the API
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU07739>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:40:58Z',
 'fuel_type': 'petrol',
 'id': 'cd948979-429a-5345-950d-a71727b89247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU07739',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 50253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2022}
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU07739%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [auto1.it] INFO: Saving data for RU07739: {'auction_closing_time': 1765039258.0, 'created_time': 1764878444.024634, 'last_price_update_time': 1764964944.401919}
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU07739') HTTP/1.1" 204 0
2025-12-05 20:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_2f0154d2e61c2c018a61804777424bf2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_884c41be7ba4c8c46f75895133d939b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_95413a5eaca86bc1b0dcba48c221e749.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_95413a5eaca86bc1b0dcba48c221e749.jpg not downloaded yet
2025-12-05 20:02:24 [scrapy.extensions.logstats] INFO: Crawled 171 pages (at 81 pages/min), scraped 55 items (at 31 items/min)
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a6946145f89dc5f4ca3831d639d6b9ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a6946145f89dc5f4ca3831d639d6b9ca.jpg not downloaded yet
2025-12-05 20:02:24 [auto1.it] INFO: Found listing with ID: PU99942
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU99942%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [auto1.it] INFO: Scrape type for PU99942: 0
2025-12-05 20:02:24 [auto1.it] INFO: Found listing with ID: RW28889
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW28889%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [auto1.it] INFO: Scrape type for RW28889: 0
2025-12-05 20:02:24 [auto1.it] INFO: Found listing with ID: ZW50433
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW50433%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [auto1.it] INFO: Scrape type for ZW50433: 2
2025-12-05 20:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159f4eb9-b73c-56d6-9b6a-7ae84d177328 with identifier: UA01461
2025-12-05 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328 with scrape type 1
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_e0f5179b2d6cda22427e44bbbc912a5a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_e0f5179b2d6cda22427e44bbbc912a5a.jpg not downloaded yet
2025-12-05 20:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892
2025-12-05 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f22194b-8131-53ec-b449-73c4599c1646 with scrape type 2
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f22194b-8131-53ec-b449-73c4599c1646 with scrape type 2
2025-12-05 20:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f22194b-8131-53ec-b449-73c4599c1646, identifier: NF03892
2025-12-05 20:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8864f4d4-9435-5d2a-b309-e4fbb926d781 with identifier: LC91200
2025-12-05 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8864f4d4-9435-5d2a-b309-e4fbb926d781 with scrape type 2
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8864f4d4-9435-5d2a-b309-e4fbb926d781 with scrape type 2
2025-12-05 20:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8864f4d4-9435-5d2a-b309-e4fbb926d781, identifier: LC91200
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_6b0cb754e6209e6fcda6536c4bb9691a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_6b0cb754e6209e6fcda6536c4bb9691a.jpg not downloaded yet
2025-12-05 20:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892
2025-12-05 20:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892
2025-12-05 20:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892 to the API
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF03892>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:46:21Z',
 'fuel_type': 'petrol',
 'id': '0f22194b-8131-53ec-b449-73c4599c1646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF03892',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 35354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF03892%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [auto1.it] INFO: Saving data for NF03892: {'auction_closing_time': 1765039581.0, 'created_time': 1763150776.619691, 'last_price_update_time': 1764964945.188106}
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF03892') HTTP/1.1" 204 0
2025-12-05 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8864f4d4-9435-5d2a-b309-e4fbb926d781 with identifier: LC91200
2025-12-05 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8864f4d4-9435-5d2a-b309-e4fbb926d781 with identifier: LC91200
2025-12-05 20:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8864f4d4-9435-5d2a-b309-e4fbb926d781 with identifier: LC91200 to the API
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LC91200>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:41:46Z',
 'fuel_type': 'diesel',
 'id': '8864f4d4-9435-5d2a-b309-e4fbb926d781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC91200',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 143485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2020}
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC91200%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [auto1.it] INFO: Saving data for LC91200: {'auction_closing_time': 1765039306.0, 'created_time': 1764878429.439481, 'last_price_update_time': 1764964945.550921}
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC91200') HTTP/1.1" 204 0
2025-12-05 20:02:25 [auto1.it] INFO: Found listing with ID: RS56178
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56178%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [auto1.it] INFO: Scrape type for RS56178: 0
2025-12-05 20:02:25 [auto1.it] INFO: Found listing with ID: BB58420
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB58420%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [auto1.it] INFO: Scrape type for BB58420: 0
2025-12-05 20:02:25 [auto1.it] INFO: Found listing with ID: RD01541
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01541%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [auto1.it] INFO: Scrape type for RD01541: 0
2025-12-05 20:02:25 [auto1.it] INFO: Found listing with ID: LG38925
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG38925%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [auto1.it] INFO: Scrape type for LG38925: 0
2025-12-05 20:02:25 [auto1.it] INFO: Found listing with ID: ME55012
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME55012%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [auto1.it] INFO: Scrape type for ME55012: 1
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_af26f1d8626343b9e2eeb0b0399cc97b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_af26f1d8626343b9e2eeb0b0399cc97b.jpg not downloaded yet
2025-12-05 20:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae4ffa9d0>
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_02f9b616495860ab47e20a6004f744ea.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_02f9b616495860ab47e20a6004f744ea.jpg saved to cache
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d260d15a-7385-5dcd-8bc6-c6c655ac72f9 with identifier: TD37557
2025-12-05 20:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d260d15a-7385-5dcd-8bc6-c6c655ac72f9 with scrape type 2
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d260d15a-7385-5dcd-8bc6-c6c655ac72f9 with scrape type 2
2025-12-05 20:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d260d15a-7385-5dcd-8bc6-c6c655ac72f9, identifier: TD37557
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e4e5fd45618206d85a4629976b93054d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_d3148204373ad8598aceb98652caecdf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_17152cb3e0003d387a3e58352a06e210.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_17152cb3e0003d387a3e58352a06e210.jpg not downloaded yet
2025-12-05 20:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d260d15a-7385-5dcd-8bc6-c6c655ac72f9 with identifier: TD37557
2025-12-05 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d260d15a-7385-5dcd-8bc6-c6c655ac72f9 with identifier: TD37557
2025-12-05 20:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d260d15a-7385-5dcd-8bc6-c6c655ac72f9 with identifier: TD37557 to the API
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TD37557>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 225,
 'expiration_date': '2025-12-06T16:44:49Z',
 'fuel_type': 'petrol',
 'id': 'd260d15a-7385-5dcd-8bc6-c6c655ac72f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD37557',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 63234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD37557%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [auto1.it] INFO: Saving data for TD37557: {'auction_closing_time': 1765039489.0, 'created_time': 1764014472.595332, 'last_price_update_time': 1764964946.462339}
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD37557') HTTP/1.1" 204 0
2025-12-05 20:02:26 [auto1.it] INFO: Found listing with ID: BZ67729
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ67729%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [auto1.it] INFO: Scrape type for BZ67729: 0
2025-12-05 20:02:26 [auto1.it] INFO: Found listing with ID: YY81592
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY81592%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [auto1.it] INFO: Scrape type for YY81592: 0
2025-12-05 20:02:26 [auto1.it] INFO: Found listing with ID: RL30055
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL30055%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [auto1.it] INFO: Scrape type for RL30055: 0
2025-12-05 20:02:26 [auto1.it] INFO: Found listing with ID: UJ58840
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ58840%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [auto1.it] INFO: Scrape type for UJ58840: 0
2025-12-05 20:02:26 [auto1.it] INFO: Found listing with ID: UW43459
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW43459%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [auto1.it] INFO: Scrape type for UW43459: 2
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_0e7cdaa68214fe316360b019a029bdbc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0e7cdaa68214fe316360b019a029bdbc.jpg not downloaded yet
2025-12-05 20:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0190ad0>
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_2f0154d2e61c2c018a61804777424bf2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_2f0154d2e61c2c018a61804777424bf2.jpg saved to cache
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c5f10>
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_884c41be7ba4c8c46f75895133d939b5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_884c41be7ba4c8c46f75895133d939b5.jpg saved to cache
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_12419c6f79b212a75d58ff148b1b1535.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_12419c6f79b212a75d58ff148b1b1535.jpg not downloaded yet
2025-12-05 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_dcd800beed8c2d6b5f6511f4020dd3f6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: HE14591
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE14591%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for HE14591: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: FN45149
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN45149%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for FN45149: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: FR46544
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR46544%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for FR46544: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: GY05920
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05920%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for GY05920: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: LZ25760
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for LZ25760: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: LJ31418
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ31418%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for LJ31418: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: LC75802
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC75802%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for LC75802: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: MJ69210
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ69210%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for MJ69210: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: KN71804
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN71804%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for KN71804: 0
2025-12-05 20:02:27 [auto1.it] INFO: Found listing with ID: UC23056
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC23056%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [auto1.it] INFO: Scrape type for UC23056: 2
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_c8c0f5b9616b0f86dcb35652ad365510.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c8c0f5b9616b0f86dcb35652ad365510.jpg not downloaded yet
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04baa90>
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_e4e5fd45618206d85a4629976b93054d.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e4e5fd45618206d85a4629976b93054d.jpg saved to cache
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae020b350>
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_d3148204373ad8598aceb98652caecdf.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_d3148204373ad8598aceb98652caecdf.jpg saved to cache
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_c4b89b4eba1d460aeebd0750d123a5ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_5f3960664e0914e5830ba1fdcad9add5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:28 [auto1.it] INFO: Found listing with ID: PY09316
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY09316%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [auto1.it] INFO: Scrape type for PY09316: 2
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a806ca154cefc01477a8b20b002022e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a806ca154cefc01477a8b20b002022e4.jpg not downloaded yet
2025-12-05 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT49386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE71060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ69591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH12738/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:28 [auto1.it] INFO: Found listing with ID: JX07186
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX07186%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [auto1.it] INFO: Scrape type for JX07186: 0
2025-12-05 20:02:28 [auto1.it] INFO: Found listing with ID: BJ61163
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ61163%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [auto1.it] INFO: Scrape type for BJ61163: 0
2025-12-05 20:02:28 [auto1.it] INFO: Found listing with ID: DJ97439
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ97439%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [auto1.it] INFO: Scrape type for DJ97439: 0
2025-12-05 20:02:28 [auto1.it] INFO: Found listing with ID: RX64693
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX64693%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [auto1.it] INFO: Scrape type for RX64693: 0
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_878389eea4691fef9b2d9bf89afb2652.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_878389eea4691fef9b2d9bf89afb2652.jpg not downloaded yet
2025-12-05 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae020f410>
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_dcd800beed8c2d6b5f6511f4020dd3f6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_dcd800beed8c2d6b5f6511f4020dd3f6.jpg saved to cache
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_af26f1d8626343b9e2eeb0b0399cc97b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a8ae0b0bb5b8ac08fc3c118aa2af323e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a8ae0b0bb5b8ac08fc3c118aa2af323e.jpg not downloaded yet
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_12419c6f79b212a75d58ff148b1b1535.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_0f2e23ccaec5127ae977cf675d7cbcd6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0f2e23ccaec5127ae977cf675d7cbcd6.jpg not downloaded yet
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae031a490>
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_c4b89b4eba1d460aeebd0750d123a5ba.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_c4b89b4eba1d460aeebd0750d123a5ba.jpg saved to cache
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05cb390>
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_5f3960664e0914e5830ba1fdcad9add5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_5f3960664e0914e5830ba1fdcad9add5.jpg saved to cache
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_4284a5758a885e58d29cb1df1e362b4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c8c0f5b9616b0f86dcb35652ad365510.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a846285dff57e0fec87f465781eb96a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a846285dff57e0fec87f465781eb96a0.jpg not downloaded yet
2025-12-05 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a806ca154cefc01477a8b20b002022e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_8c5724620056967501a59b3d6a1a4ee5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_8c5724620056967501a59b3d6a1a4ee5.jpg not downloaded yet
2025-12-05 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME55012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a2f0b1f7ae0e23ab981bb43f790dc0cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_fc23eaf690e1b48d75225546badf1e48.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_fc23eaf690e1b48d75225546badf1e48.jpg not downloaded yet
2025-12-05 20:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3717950>
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_af26f1d8626343b9e2eeb0b0399cc97b.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_af26f1d8626343b9e2eeb0b0399cc97b.jpg saved to cache
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3715ad0>
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_12419c6f79b212a75d58ff148b1b1535.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_12419c6f79b212a75d58ff148b1b1535.jpg saved to cache
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_17152cb3e0003d387a3e58352a06e210.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_878389eea4691fef9b2d9bf89afb2652.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_1bded03c29a005f7f38fa0a2d4dcb2f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_1bded03c29a005f7f38fa0a2d4dcb2f9.jpg not downloaded yet
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC23056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_c9cfc13816d782a4b89e0c3e1206bcb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c9cfc13816d782a4b89e0c3e1206bcb0.jpg not downloaded yet
2025-12-05 20:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014ebd0>
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_4284a5758a885e58d29cb1df1e362b4c.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_4284a5758a885e58d29cb1df1e362b4c.jpg saved to cache
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae043da10>
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_c8c0f5b9616b0f86dcb35652ad365510.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c8c0f5b9616b0f86dcb35652ad365510.jpg saved to cache
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0132d10>
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a806ca154cefc01477a8b20b002022e4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a806ca154cefc01477a8b20b002022e4.jpg saved to cache
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:31 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05686d0>
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a2f0b1f7ae0e23ab981bb43f790dc0cd.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a2f0b1f7ae0e23ab981bb43f790dc0cd.jpg saved to cache
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_8c5724620056967501a59b3d6a1a4ee5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_fc23eaf690e1b48d75225546badf1e48.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a40ce15e3cec3e0fed4830144b8c2ca2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a40ce15e3cec3e0fed4830144b8c2ca2.jpg not downloaded yet
2025-12-05 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e13c7e4a9a1ea0c040e33da2a1934620.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_70713c0303bd1fc5570c89b371d9b15a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:31 [auto1.it] INFO: Found listing with ID: YH36098
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH36098%27 HTTP/1.1" 200 None
2025-12-05 20:02:31 [auto1.it] INFO: Scrape type for YH36098: 0
2025-12-05 20:02:31 [auto1.it] INFO: Found listing with ID: HT90813
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT90813%27 HTTP/1.1" 200 None
2025-12-05 20:02:31 [auto1.it] INFO: Scrape type for HT90813: 2
2025-12-05 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY09316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02de910>
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_17152cb3e0003d387a3e58352a06e210.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_17152cb3e0003d387a3e58352a06e210.jpg saved to cache
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05e51d0>
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_878389eea4691fef9b2d9bf89afb2652.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_878389eea4691fef9b2d9bf89afb2652.jpg saved to cache
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_255d8a8d215fb9f3eb4c0a61c6af1cce.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_255d8a8d215fb9f3eb4c0a61c6af1cce.jpg not downloaded yet
2025-12-05 20:02:32 [auto1.it] INFO: Found listing with ID: HX83454
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX83454%27 HTTP/1.1" 200 None
2025-12-05 20:02:32 [auto1.it] INFO: Scrape type for HX83454: 0
2025-12-05 20:02:32 [auto1.it] INFO: Found listing with ID: LG15612
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG15612%27 HTTP/1.1" 200 None
2025-12-05 20:02:32 [auto1.it] INFO: Scrape type for LG15612: 0
2025-12-05 20:02:32 [auto1.it] INFO: Found listing with ID: UV47695
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2025-12-05 20:02:32 [auto1.it] INFO: Scrape type for UV47695: 0
2025-12-05 20:02:32 [auto1.it] INFO: Found listing with ID: BR12056
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR12056%27 HTTP/1.1" 200 None
2025-12-05 20:02:32 [auto1.it] INFO: Scrape type for BR12056: 0
2025-12-05 20:02:32 [auto1.it] INFO: Found listing with ID: GE92322
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE92322%27 HTTP/1.1" 200 None
2025-12-05 20:02:32 [auto1.it] INFO: Scrape type for GE92322: 2
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0129ed0>
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_8c5724620056967501a59b3d6a1a4ee5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_8c5724620056967501a59b3d6a1a4ee5.jpg saved to cache
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0314250>
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_fc23eaf690e1b48d75225546badf1e48.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_fc23eaf690e1b48d75225546badf1e48.jpg saved to cache
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0613790>
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_e13c7e4a9a1ea0c040e33da2a1934620.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e13c7e4a9a1ea0c040e33da2a1934620.jpg saved to cache
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae010d7d0>
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_70713c0303bd1fc5570c89b371d9b15a.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_70713c0303bd1fc5570c89b371d9b15a.jpg saved to cache
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_6c66901c509f61f7e34703a99fd80ebe.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_1bded03c29a005f7f38fa0a2d4dcb2f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0f2e23ccaec5127ae977cf675d7cbcd6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:33 [auto1.it] INFO: Found listing with ID: LR58377
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR58377%27 HTTP/1.1" 200 None
2025-12-05 20:02:33 [auto1.it] INFO: Scrape type for LR58377: 0
2025-12-05 20:02:33 [auto1.it] INFO: Found listing with ID: BT39914
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT39914%27 HTTP/1.1" 200 None
2025-12-05 20:02:33 [auto1.it] INFO: Scrape type for BT39914: 1
2025-12-05 20:02:33 [auto1.it] INFO: Found listing with ID: FB33049
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB33049%27 HTTP/1.1" 200 None
2025-12-05 20:02:33 [auto1.it] INFO: Scrape type for FB33049: 0
2025-12-05 20:02:33 [auto1.it] INFO: Found listing with ID: GZ38175
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ38175%27 HTTP/1.1" 200 None
2025-12-05 20:02:33 [auto1.it] INFO: Scrape type for GZ38175: 0
2025-12-05 20:02:33 [auto1.it] INFO: Found listing with ID: TF80780
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF80780%27 HTTP/1.1" 200 None
2025-12-05 20:02:33 [auto1.it] INFO: Scrape type for TF80780: 2
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW43459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE71060> (referer: https://www.auto1.com/v1/car-details-view/GE71060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT49386> (referer: https://www.auto1.com/v1/car-details-view/FT49386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH12738> (referer: https://www.auto1.com/v1/car-details-view/KH12738/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ69591> (referer: https://www.auto1.com/v1/car-details-view/YJ69591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02be910>
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_6c66901c509f61f7e34703a99fd80ebe.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_6c66901c509f61f7e34703a99fd80ebe.jpg saved to cache
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c7890>
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_1bded03c29a005f7f38fa0a2d4dcb2f9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_1bded03c29a005f7f38fa0a2d4dcb2f9.jpg saved to cache
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0184b50>
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_0f2e23ccaec5127ae977cf675d7cbcd6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0f2e23ccaec5127ae977cf675d7cbcd6.jpg saved to cache
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:34 [auto1.it] INFO: Found listing with ID: GR38482
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR38482%27 HTTP/1.1" 200 None
2025-12-05 20:02:34 [auto1.it] INFO: Scrape type for GR38482: 2
2025-12-05 20:02:34 [auto1.it] INFO: Found listing with ID: FE68009
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE68009%27 HTTP/1.1" 200 None
2025-12-05 20:02:34 [auto1.it] INFO: Scrape type for FE68009: 0
2025-12-05 20:02:34 [auto1.it] INFO: Found listing with ID: SC05973
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05973%27 HTTP/1.1" 200 None
2025-12-05 20:02:34 [auto1.it] INFO: Scrape type for SC05973: 0
2025-12-05 20:02:34 [auto1.it] INFO: Found listing with ID: BF65638
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF65638%27 HTTP/1.1" 200 None
2025-12-05 20:02:34 [auto1.it] INFO: Scrape type for BF65638: 1
2025-12-05 20:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e399493d-9000-522a-b736-2da73624684c with identifier: GE71060
2025-12-05 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e399493d-9000-522a-b736-2da73624684c with scrape type 2
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e399493d-9000-522a-b736-2da73624684c with scrape type 2
2025-12-05 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e399493d-9000-522a-b736-2da73624684c, identifier: GE71060
2025-12-05 20:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6 with identifier: FT49386
2025-12-05 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6 with scrape type 2
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6 with scrape type 2
2025-12-05 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6, identifier: FT49386
2025-12-05 20:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f1330e-7402-5608-979e-3d745d94b69b with identifier: KH12738
2025-12-05 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f1330e-7402-5608-979e-3d745d94b69b with scrape type 1
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c0f1330e-7402-5608-979e-3d745d94b69b
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_1f1d51c47c9182f1cab1c64ca81a7f22.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_1f1d51c47c9182f1cab1c64ca81a7f22.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_0613c71e9f3eea5a1dfe086145197afc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_0613c71e9f3eea5a1dfe086145197afc.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_7ddd0d64c8a0792c79a786d75e9e2b99.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_7ddd0d64c8a0792c79a786d75e9e2b99.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_263c9f81ec51ed82cde336fa9162cdde.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_263c9f81ec51ed82cde336fa9162cdde.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_f0920c57a771bb4086b1508635ec51fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_f0920c57a771bb4086b1508635ec51fe.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_a52d6e2397e96df7fe839f3b619350df.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_a52d6e2397e96df7fe839f3b619350df.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_ce54d5b49e9a33e0a7bdd7f9d4eddf4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ce54d5b49e9a33e0a7bdd7f9d4eddf4c.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_1a70bb3dc239c93d80bfa8bcf1c61362.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_1a70bb3dc239c93d80bfa8bcf1c61362.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_7d58f5acd08c9b4aca1de04c885c25d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_7d58f5acd08c9b4aca1de04c885c25d4.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_ac5a53f26a292fb80a4fb67d4e677ada.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ac5a53f26a292fb80a4fb67d4e677ada.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_e9f9c7fb49d445a608fc79cfbb79147a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_e9f9c7fb49d445a608fc79cfbb79147a.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_574a9e02bf52745bad02b4689b73edd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_574a9e02bf52745bad02b4689b73edd7.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_6247174a6e75689cbda6057075ec324d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_6247174a6e75689cbda6057075ec324d.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_4b503a100356e226a9f14c7231e056c2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_4b503a100356e226a9f14c7231e056c2.jpg already downloaded
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F46%252F62465f56f96a566b48fcb6d40fd1d49e%252Fpa%252FKH12738_ef63a492065f4bae0532792f58b6d066.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ef63a492065f4bae0532792f58b6d066.jpg already downloaded
2025-12-05 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0f1330e-7402-5608-979e-3d745d94b69b, identifier: KH12738
2025-12-05 20:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8d430e-4278-56dc-9af8-0314ad0ef114 with identifier: YJ69591
2025-12-05 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8d430e-4278-56dc-9af8-0314ad0ef114 with scrape type 2
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8d430e-4278-56dc-9af8-0314ad0ef114 with scrape type 2
2025-12-05 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c8d430e-4278-56dc-9af8-0314ad0ef114, identifier: YJ69591
2025-12-05 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e399493d-9000-522a-b736-2da73624684c with identifier: GE71060
2025-12-05 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e399493d-9000-522a-b736-2da73624684c with identifier: GE71060
2025-12-05 20:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e399493d-9000-522a-b736-2da73624684c with identifier: GE71060 to the API
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GE71060>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:21:09Z',
 'fuel_type': 'diesel',
 'id': 'e399493d-9000-522a-b736-2da73624684c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE71060',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 141996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Business AWD',
 'transmission': 'automatic',
 'trim': 'Business AWD',
 'year': 2018}
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE71060%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [auto1.it] INFO: Saving data for GE71060: {'auction_closing_time': 1765038069.0, 'created_time': 1764878512.285056, 'last_price_update_time': 1764964956.237298}
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE71060') HTTP/1.1" 204 0
2025-12-05 20:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6 with identifier: FT49386
2025-12-05 20:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6 with identifier: FT49386
2025-12-05 20:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6 with identifier: FT49386 to the API
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FT49386>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2025-12-06T16:39:47Z',
 'fuel_type': 'diesel',
 'id': 'cf0107c3-b1a7-5f6b-ac9f-bcf0bd30a2d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT49386',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 139874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Business',
 'transmission': 'automatic',
 'trim': '4Matic Business',
 'year': 2020}
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT49386%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [auto1.it] INFO: Saving data for FT49386: {'auction_closing_time': 1765039187.0, 'created_time': 1764237762.649307, 'last_price_update_time': 1764964956.803147}
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT49386') HTTP/1.1" 204 0
2025-12-05 20:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0f1330e-7402-5608-979e-3d745d94b69b with identifier: KH12738
2025-12-05 20:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0f1330e-7402-5608-979e-3d745d94b69b with identifier: KH12738
2025-12-05 20:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0f1330e-7402-5608-979e-3d745d94b69b with identifier: KH12738 to the API
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KH12738>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:15:46Z',
 'fuel_type': 'diesel',
 'id': 'c0f1330e-7402-5608-979e-3d745d94b69b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH12738',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 104559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_1f1d51c47c9182f1cab1c64ca81a7f22.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_0613c71e9f3eea5a1dfe086145197afc.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_7ddd0d64c8a0792c79a786d75e9e2b99.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_263c9f81ec51ed82cde336fa9162cdde.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_f0920c57a771bb4086b1508635ec51fe.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_a52d6e2397e96df7fe839f3b619350df.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ce54d5b49e9a33e0a7bdd7f9d4eddf4c.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_1a70bb3dc239c93d80bfa8bcf1c61362.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_7d58f5acd08c9b4aca1de04c885c25d4.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ac5a53f26a292fb80a4fb67d4e677ada.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_e9f9c7fb49d445a608fc79cfbb79147a.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_574a9e02bf52745bad02b4689b73edd7.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_6247174a6e75689cbda6057075ec324d.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_4b503a100356e226a9f14c7231e056c2.jpg',
                'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ef63a492065f4bae0532792f58b6d066.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739444,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_1f1d51c47c9182f1cab1c64ca81a7f22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_0613c71e9f3eea5a1dfe086145197afc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_7ddd0d64c8a0792c79a786d75e9e2b99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637660,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_263c9f81ec51ed82cde336fa9162cdde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_f0920c57a771bb4086b1508635ec51fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_a52d6e2397e96df7fe839f3b619350df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ce54d5b49e9a33e0a7bdd7f9d4eddf4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_1a70bb3dc239c93d80bfa8bcf1c61362.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_7d58f5acd08c9b4aca1de04c885c25d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ac5a53f26a292fb80a4fb67d4e677ada.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2785082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_e9f9c7fb49d445a608fc79cfbb79147a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3126181,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_574a9e02bf52745bad02b4689b73edd7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_6247174a6e75689cbda6057075ec324d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_4b503a100356e226a9f14c7231e056c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f1330e-7402-5608-979e-3d745d94b69b/c0f1330e-7402-5608-979e-3d745d94b69b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/46/62465f56f96a566b48fcb6d40fd1d49e/pa/KH12738_ef63a492065f4bae0532792f58b6d066.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH12738%27 HTTP/1.1" 200 None
2025-12-05 20:02:37 [auto1.it] INFO: Saving data for KH12738: {'created_time': 1764964957.179577, 'last_price_update_time': 1764964957.17959, 'auction_closing_time': 1765037746.0}
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KH12738') HTTP/1.1" 204 0
2025-12-05 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c8d430e-4278-56dc-9af8-0314ad0ef114 with identifier: YJ69591
2025-12-05 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c8d430e-4278-56dc-9af8-0314ad0ef114 with identifier: YJ69591
2025-12-05 20:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c8d430e-4278-56dc-9af8-0314ad0ef114 with identifier: YJ69591 to the API
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ69591>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:19:46Z',
 'fuel_type': 'petrol',
 'id': '6c8d430e-4278-56dc-9af8-0314ad0ef114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ69591',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 68728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2019}
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ69591%27 HTTP/1.1" 200 None
2025-12-05 20:02:38 [auto1.it] INFO: Saving data for YJ69591: {'auction_closing_time': 1765037986.0, 'created_time': 1762768931.907481, 'last_price_update_time': 1764964958.19487}
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ69591') HTTP/1.1" 204 0
2025-12-05 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c9cfc13816d782a4b89e0c3e1206bcb0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a8ae0b0bb5b8ac08fc3c118aa2af323e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:38 [auto1.it] INFO: Found listing with ID: JD19980
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD19980%27 HTTP/1.1" 200 None
2025-12-05 20:02:38 [auto1.it] INFO: Scrape type for JD19980: 0
2025-12-05 20:02:38 [auto1.it] INFO: Found listing with ID: LM12647
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2025-12-05 20:02:38 [auto1.it] INFO: Scrape type for LM12647: 0
2025-12-05 20:02:38 [auto1.it] INFO: Found listing with ID: GW70915
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW70915%27 HTTP/1.1" 200 None
2025-12-05 20:02:38 [auto1.it] INFO: Scrape type for GW70915: 0
2025-12-05 20:02:38 [auto1.it] INFO: Found listing with ID: YN88087
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN88087%27 HTTP/1.1" 200 None
2025-12-05 20:02:38 [auto1.it] INFO: Scrape type for YN88087: 0
2025-12-05 20:02:38 [auto1.it] INFO: Found listing with ID: TS66392
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS66392%27 HTTP/1.1" 200 None
2025-12-05 20:02:38 [auto1.it] INFO: Scrape type for TS66392: 1
2025-12-05 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_ca42cd001556cf48291f1cd77fbe360f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_255d8a8d215fb9f3eb4c0a61c6af1cce.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_6b0cb754e6209e6fcda6536c4bb9691a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:38 [auto1.it] INFO: Found listing with ID: BL60160
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL60160%27 HTTP/1.1" 200 None
2025-12-05 20:02:38 [auto1.it] INFO: Scrape type for BL60160: 1
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0192f50>
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_c9cfc13816d782a4b89e0c3e1206bcb0.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c9cfc13816d782a4b89e0c3e1206bcb0.jpg saved to cache
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae040b7d0>
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a8ae0b0bb5b8ac08fc3c118aa2af323e.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a8ae0b0bb5b8ac08fc3c118aa2af323e.jpg saved to cache
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:38 [auto1.it] INFO: Found listing with ID: VU49285
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU49285%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for VU49285: 0
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: RK87672
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK87672%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for RK87672: 0
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: AJ43419
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ43419%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for AJ43419: 0
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: EV89317
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV89317%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for EV89317: 2
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: RK40358
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK40358%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for RK40358: 0
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: HG98789
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG98789%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for HG98789: 1
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: AY82882
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY82882%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for AY82882: 0
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: NG74422
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74422%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for NG74422: 0
2025-12-05 20:02:39 [auto1.it] INFO: Found listing with ID: NA63164
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA63164%27 HTTP/1.1" 200 None
2025-12-05 20:02:39 [auto1.it] INFO: Scrape type for NA63164: 1
2025-12-05 20:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a63d0>
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_ca42cd001556cf48291f1cd77fbe360f.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_ca42cd001556cf48291f1cd77fbe360f.jpg saved to cache
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04794d0>
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_255d8a8d215fb9f3eb4c0a61c6af1cce.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_255d8a8d215fb9f3eb4c0a61c6af1cce.jpg saved to cache
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0093450>
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_6b0cb754e6209e6fcda6536c4bb9691a.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_6b0cb754e6209e6fcda6536c4bb9691a.jpg saved to cache
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: NZ23957
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ23957%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for NZ23957: 0
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: SE73703
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE73703%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for SE73703: 2
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT39914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: EK48901
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK48901%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for EK48901: 0
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: UA95207
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA95207%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for UA95207: 2
2025-12-05 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: ZU44303
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU44303%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for ZU44303: 0
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: NE58179
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE58179%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for NE58179: 0
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: ZC07011
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC07011%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for ZC07011: 2
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0e7cdaa68214fe316360b019a029bdbc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: RG65922
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG65922%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for RG65922: 0
2025-12-05 20:02:40 [auto1.it] INFO: Found listing with ID: DY09053
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY09053%27 HTTP/1.1" 200 None
2025-12-05 20:02:40 [auto1.it] INFO: Scrape type for DY09053: 0
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a846285dff57e0fec87f465781eb96a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a40ce15e3cec3e0fed4830144b8c2ca2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_e0f5179b2d6cda22427e44bbbc912a5a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a50d0>
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_0e7cdaa68214fe316360b019a029bdbc.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0e7cdaa68214fe316360b019a029bdbc.jpg saved to cache
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT90813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC23056> (referer: https://www.auto1.com/v1/car-details-view/UC23056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02ee690>
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a846285dff57e0fec87f465781eb96a0.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a846285dff57e0fec87f465781eb96a0.jpg saved to cache
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e7890>
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_a40ce15e3cec3e0fed4830144b8c2ca2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a40ce15e3cec3e0fed4830144b8c2ca2.jpg saved to cache
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e58d0>
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fae%252F53aecfce6f99007220e6863f120bbfc5%252Fpa%252FUA01461_e0f5179b2d6cda22427e44bbbc912a5a.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_e0f5179b2d6cda22427e44bbbc912a5a.jpg saved to cache
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328
2025-12-05 20:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 159f4eb9-b73c-56d6-9b6a-7ae84d177328, skipping ID generation
2025-12-05 20:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328 with scrape type 1
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 159f4eb9-b73c-56d6-9b6a-7ae84d177328 from tracking dictionaries
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 159f4eb9-b73c-56d6-9b6a-7ae84d177328 sending to next pipeline
2025-12-05 20:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 159f4eb9-b73c-56d6-9b6a-7ae84d177328, identifier: UA01461
2025-12-05 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 159f4eb9-b73c-56d6-9b6a-7ae84d177328 with identifier: UA01461
2025-12-05 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 159f4eb9-b73c-56d6-9b6a-7ae84d177328 with identifier: UA01461
2025-12-05 20:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 159f4eb9-b73c-56d6-9b6a-7ae84d177328 with identifier: UA01461 to the API
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_e0f5179b2d6cda22427e44bbbc912a5a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2025-12-06T16:45:58Z',
 'fuel_type': 'hybrid',
 'id': '159f4eb9-b73c-56d6-9b6a-7ae84d177328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA01461',
 'listing': 'auction',
 'location': 'IT, Arezzo',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 113239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2343771,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_e0f5179b2d6cda22427e44bbbc912a5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_af26f1d8626343b9e2eeb0b0399cc97b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2274766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0e7cdaa68214fe316360b019a029bdbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c8c0f5b9616b0f86dcb35652ad365510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a806ca154cefc01477a8b20b002022e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_878389eea4691fef9b2d9bf89afb2652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a8ae0b0bb5b8ac08fc3c118aa2af323e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_0f2e23ccaec5127ae977cf675d7cbcd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394610,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a846285dff57e0fec87f465781eb96a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_8c5724620056967501a59b3d6a1a4ee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_fc23eaf690e1b48d75225546badf1e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_1bded03c29a005f7f38fa0a2d4dcb2f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_c9cfc13816d782a4b89e0c3e1206bcb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_a40ce15e3cec3e0fed4830144b8c2ca2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159f4eb9-b73c-56d6-9b6a-7ae84d177328/159f4eb9-b73c-56d6-9b6a-7ae84d177328_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ae/53aecfce6f99007220e6863f120bbfc5/pa/UA01461_255d8a8d215fb9f3eb4c0a61c6af1cce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA01461%27 HTTP/1.1" 200 None
2025-12-05 20:02:42 [auto1.it] INFO: Saving data for UA01461: {'created_time': 1764964962.6431, 'last_price_update_time': 1764964962.64311, 'auction_closing_time': 1765039558.0}
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA01461') HTTP/1.1" 204 0
2025-12-05 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME55012> (referer: https://www.auto1.com/v1/car-details-view/ME55012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA54226> (referer: https://www.auto1.com/v1/car-details-view/UA54226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY09316> (referer: https://www.auto1.com/v1/car-details-view/PY09316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE92322/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW43459> (referer: https://www.auto1.com/v1/car-details-view/UW43459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:42 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87c17287-9b1c-5772-9a88-d24b537fb8ac with identifier: UC23056
2025-12-05 20:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c17287-9b1c-5772-9a88-d24b537fb8ac with scrape type 2
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87c17287-9b1c-5772-9a88-d24b537fb8ac with scrape type 2
2025-12-05 20:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 87c17287-9b1c-5772-9a88-d24b537fb8ac, identifier: UC23056
2025-12-05 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 87c17287-9b1c-5772-9a88-d24b537fb8ac with identifier: UC23056
2025-12-05 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 87c17287-9b1c-5772-9a88-d24b537fb8ac with identifier: UC23056
2025-12-05 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154514 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154514
2025-12-05 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 87c17287-9b1c-5772-9a88-d24b537fb8ac spider: auto1.it
2025-12-05 20:02:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 87c17287-9b1c-5772-9a88-d24b537fb8ac due to rule: high_mileage_for_country.json, error: 154514 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154514
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:10:21Z',
 'fuel_type': 'diesel',
 'id': '87c17287-9b1c-5772-9a88-d24b537fb8ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC23056',
 'listing': 'auction',
 'location': 'IT, Surbo',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 154514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid N Line 2WD',
 'transmission': 'automatic',
 'trim': 'N Line 2WD',
 'year': 2022}
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC23056%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [auto1.it] INFO: Saving data for UC23056: {'auction_closing_time': 1765037421.0, 'created_time': 1764878516.484184, 'last_price_update_time': 1764964963.130031}
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UC23056') HTTP/1.1" 204 0
2025-12-05 20:02:43 [auto1.it] INFO: Found listing with ID: XL18907
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL18907%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [auto1.it] INFO: Scrape type for XL18907: 2
2025-12-05 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bb78844-bb2b-58ee-bf18-b08ad29086bb with identifier: ME55012
2025-12-05 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb with scrape type 1
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_b9f8d3898218aa694926acbca2ccad3c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_b9f8d3898218aa694926acbca2ccad3c.jpg not downloaded yet
2025-12-05 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e67137c9-d23d-514b-9cc5-93a39fb0f158 with identifier: UA54226
2025-12-05 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e67137c9-d23d-514b-9cc5-93a39fb0f158 with scrape type 2
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e67137c9-d23d-514b-9cc5-93a39fb0f158 with scrape type 2
2025-12-05 20:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e67137c9-d23d-514b-9cc5-93a39fb0f158, identifier: UA54226
2025-12-05 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 991646b4-27a3-511f-a2e6-c2e5d1a8a4db with identifier: PY09316
2025-12-05 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 991646b4-27a3-511f-a2e6-c2e5d1a8a4db with scrape type 2
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 991646b4-27a3-511f-a2e6-c2e5d1a8a4db with scrape type 2
2025-12-05 20:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 991646b4-27a3-511f-a2e6-c2e5d1a8a4db, identifier: PY09316
2025-12-05 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8 with identifier: UW43459
2025-12-05 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8 with scrape type 2
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8 with scrape type 2
2025-12-05 20:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8, identifier: UW43459
2025-12-05 20:02:43 [auto1.it] INFO: Found listing with ID: EN94369
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN94369%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [auto1.it] INFO: Scrape type for EN94369: 0
2025-12-05 20:02:43 [auto1.it] INFO: Found listing with ID: TG21070
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG21070%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [auto1.it] INFO: Scrape type for TG21070: 0
2025-12-05 20:02:43 [auto1.it] INFO: Found listing with ID: HY15868
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY15868%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [auto1.it] INFO: Scrape type for HY15868: 0
2025-12-05 20:02:43 [auto1.it] INFO: Found listing with ID: PR47123
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR47123%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [auto1.it] INFO: Scrape type for PR47123: 2
2025-12-05 20:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e67137c9-d23d-514b-9cc5-93a39fb0f158 with identifier: UA54226
2025-12-05 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e67137c9-d23d-514b-9cc5-93a39fb0f158 with identifier: UA54226
2025-12-05 20:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e67137c9-d23d-514b-9cc5-93a39fb0f158 with identifier: UA54226 to the API
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA54226>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2025-12-06T16:47:57Z',
 'fuel_type': 'petrol',
 'id': 'e67137c9-d23d-514b-9cc5-93a39fb0f158',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA54226',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'BMW',
 'model': '1er',
 'odometer': 86420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54226%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [auto1.it] INFO: Saving data for UA54226: {'auction_closing_time': 1765039677.0, 'created_time': 1764878438.760754, 'last_price_update_time': 1764964964.022968}
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA54226') HTTP/1.1" 204 0
2025-12-05 20:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 991646b4-27a3-511f-a2e6-c2e5d1a8a4db with identifier: PY09316
2025-12-05 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 991646b4-27a3-511f-a2e6-c2e5d1a8a4db with identifier: PY09316
2025-12-05 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172128 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172128
2025-12-05 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 991646b4-27a3-511f-a2e6-c2e5d1a8a4db spider: auto1.it
2025-12-05 20:02:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 991646b4-27a3-511f-a2e6-c2e5d1a8a4db due to rule: high_mileage_for_country.json, error: 172128 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172128
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:40:48Z',
 'fuel_type': 'diesel',
 'id': '991646b4-27a3-511f-a2e6-c2e5d1a8a4db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY09316',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 172128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2018}
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY09316%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [auto1.it] INFO: Saving data for PY09316: {'auction_closing_time': 1765039248.0, 'created_time': 1764316850.441585, 'last_price_update_time': 1764964964.269319}
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PY09316') HTTP/1.1" 204 0
2025-12-05 20:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8 with identifier: UW43459
2025-12-05 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8 with identifier: UW43459
2025-12-05 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2025-12-05 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8 spider: auto1.it
2025-12-05 20:02:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4262ae95-2f2d-51a9-bdc4-b2eecf8786c8 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:09:00Z',
 'fuel_type': 'diesel',
 'id': '4262ae95-2f2d-51a9-bdc4-b2eecf8786c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW43459',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 47306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Limited',
 'year': 2020}
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW43459%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [auto1.it] INFO: Saving data for UW43459: {'auction_closing_time': 1765037340.0, 'created_time': 1764360596.019808, 'last_price_update_time': 1764964964.563282}
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW43459') HTTP/1.1" 204 0
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a6946145f89dc5f4ca3831d639d6b9ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_42d25e2d1f749c4ddefa34a10f8dd339.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_42d25e2d1f749c4ddefa34a10f8dd339.jpg not downloaded yet
2025-12-05 20:02:44 [auto1.it] INFO: Found listing with ID: PP05492
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP05492%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [auto1.it] INFO: Scrape type for PP05492: 2
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF65638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF80780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR38482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_224dc676c9410d24346da467d9094138.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_224dc676c9410d24346da467d9094138.jpg not downloaded yet
2025-12-05 20:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_95413a5eaca86bc1b0dcba48c221e749.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:44 [auto1.it] INFO: Found listing with ID: XF13981
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF13981%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [auto1.it] INFO: Scrape type for XF13981: 0
2025-12-05 20:02:44 [auto1.it] INFO: Found listing with ID: LG07242
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [auto1.it] INFO: Scrape type for LG07242: 0
2025-12-05 20:02:44 [auto1.it] INFO: Found listing with ID: TZ17283
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ17283%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [auto1.it] INFO: Scrape type for TZ17283: 2
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_c06919da44a33bbd7edb2c4858f2e608.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_5460fcfaeace2b328c5c6534b6322d91.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_5460fcfaeace2b328c5c6534b6322d91.jpg not downloaded yet
2025-12-05 20:02:45 [auto1.it] INFO: Found listing with ID: XD09667
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD09667%27 HTTP/1.1" 200 None
2025-12-05 20:02:45 [auto1.it] INFO: Scrape type for XD09667: 0
2025-12-05 20:02:45 [auto1.it] INFO: Found listing with ID: MT35783
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35783%27 HTTP/1.1" 200 None
2025-12-05 20:02:45 [auto1.it] INFO: Scrape type for MT35783: 0
2025-12-05 20:02:45 [auto1.it] INFO: Found listing with ID: YS25498
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS25498%27 HTTP/1.1" 200 None
2025-12-05 20:02:45 [auto1.it] INFO: Scrape type for YS25498: 2
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a3390>
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_a6946145f89dc5f4ca3831d639d6b9ca.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a6946145f89dc5f4ca3831d639d6b9ca.jpg saved to cache
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_7339737edc6a017c25acc7931d9686a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_7339737edc6a017c25acc7931d9686a7.jpg not downloaded yet
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_b9f8d3898218aa694926acbca2ccad3c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:45 [auto1.it] INFO: Found listing with ID: MC45094
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC45094%27 HTTP/1.1" 200 None
2025-12-05 20:02:45 [auto1.it] INFO: Scrape type for MC45094: 1
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_42d25e2d1f749c4ddefa34a10f8dd339.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_36aad7827648b1de2445523201873ffb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_36aad7827648b1de2445523201873ffb.jpg not downloaded yet
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA95207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC07011/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE73703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04b8390>
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_95413a5eaca86bc1b0dcba48c221e749.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_95413a5eaca86bc1b0dcba48c221e749.jpg saved to cache
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0533850>
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_c06919da44a33bbd7edb2c4858f2e608.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_c06919da44a33bbd7edb2c4858f2e608.jpg saved to cache
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: EN92319
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN92319%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for EN92319: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: VM30492
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM30492%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for VM30492: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: TY94975
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY94975%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for TY94975: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: FN77058
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN77058%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for FN77058: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: WC40670
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC40670%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for WC40670: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: RT66786
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT66786%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for RT66786: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: UX08705
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX08705%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for UX08705: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: PM67896
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM67896%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for PM67896: 2
2025-12-05 20:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_224dc676c9410d24346da467d9094138.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_16d365bbef87bd4e84aeef1aab6344db.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_16d365bbef87bd4e84aeef1aab6344db.jpg not downloaded yet
2025-12-05 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT39914> (referer: https://www.auto1.com/v1/car-details-view/BT39914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: PM20495
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM20495%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for PM20495: 0
2025-12-05 20:02:46 [auto1.it] INFO: Found listing with ID: RZ21279
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ21279%27 HTTP/1.1" 200 None
2025-12-05 20:02:46 [auto1.it] INFO: Scrape type for RZ21279: 1
2025-12-05 20:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA63164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a29d0>
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_b9f8d3898218aa694926acbca2ccad3c.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_b9f8d3898218aa694926acbca2ccad3c.jpg saved to cache
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0077c90>
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_42d25e2d1f749c4ddefa34a10f8dd339.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_42d25e2d1f749c4ddefa34a10f8dd339.jpg saved to cache
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_acdcd75b23411d14fd0d0c1f0368d87b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_acdcd75b23411d14fd0d0c1f0368d87b.jpg not downloaded yet
2025-12-05 20:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:47 [auto1.it] INFO: Found listing with ID: CK46051
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK46051%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [auto1.it] INFO: Scrape type for CK46051: 2
2025-12-05 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_5460fcfaeace2b328c5c6534b6322d91.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_c870300bba08f73490a731ae486422d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_c870300bba08f73490a731ae486422d7.jpg not downloaded yet
2025-12-05 20:02:47 [auto1.it] INFO: Found listing with ID: DH42983
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH42983%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [auto1.it] INFO: Scrape type for DH42983: 2
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0512090>
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_224dc676c9410d24346da467d9094138.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_224dc676c9410d24346da467d9094138.jpg saved to cache
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7 with identifier: BT39914
2025-12-05 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7 with scrape type 1
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_f73df6b6bd7762ed1ea05f4d7fb3d68a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_f73df6b6bd7762ed1ea05f4d7fb3d68a.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_357c092295596954109b58273364559a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_357c092295596954109b58273364559a.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_cd32d69d244ffbb8b0b46b9e1fe7677c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_cd32d69d244ffbb8b0b46b9e1fe7677c.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_fe7f08aca781eac6ef621d32eeba169b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_fe7f08aca781eac6ef621d32eeba169b.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_5404962057f6c5b363417efb5d1e358b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_5404962057f6c5b363417efb5d1e358b.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_55561d4dd76d8efb29a85c3f28dce301.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_55561d4dd76d8efb29a85c3f28dce301.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_06b69aae8cb271aa994040fb30df9a79.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_06b69aae8cb271aa994040fb30df9a79.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_7161d946482c8262c5b2c6f1d6f3e78e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_7161d946482c8262c5b2c6f1d6f3e78e.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_621fb510e343ea991fc4af01218ae0f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_621fb510e343ea991fc4af01218ae0f2.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_a641b07f822c5e40670362e954c1cd05.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_a641b07f822c5e40670362e954c1cd05.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_600bc444842ada98457684b265ad84cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_600bc444842ada98457684b265ad84cc.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_11a15036d5617b66c1ddd2afe80429dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_11a15036d5617b66c1ddd2afe80429dc.jpg already downloaded
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F11%252F721116c17e59813278e6604db547cd73%252Fpa%252FBT39914_9405a7346f207ef245bebb818c166eac.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_9405a7346f207ef245bebb818c166eac.jpg already downloaded
2025-12-05 20:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7, identifier: BT39914
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_e5d5e3a1975b614688c3c4150e544c75.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_e5d5e3a1975b614688c3c4150e544c75.jpg not downloaded yet
2025-12-05 20:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7 with identifier: BT39914
2025-12-05 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7 with identifier: BT39914
2025-12-05 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
2025-12-05 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7 spider: auto1.it
2025-12-05 20:02:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 2f1658ff-f2d3-5843-b91d-e542a9a5c3c7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:05:56Z',
 'fuel_type': 'diesel',
 'id': '2f1658ff-f2d3-5843-b91d-e542a9a5c3c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT39914',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 64510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_f73df6b6bd7762ed1ea05f4d7fb3d68a.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_357c092295596954109b58273364559a.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_cd32d69d244ffbb8b0b46b9e1fe7677c.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_fe7f08aca781eac6ef621d32eeba169b.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_5404962057f6c5b363417efb5d1e358b.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_55561d4dd76d8efb29a85c3f28dce301.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_06b69aae8cb271aa994040fb30df9a79.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_7161d946482c8262c5b2c6f1d6f3e78e.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_621fb510e343ea991fc4af01218ae0f2.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_a641b07f822c5e40670362e954c1cd05.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_600bc444842ada98457684b265ad84cc.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_11a15036d5617b66c1ddd2afe80429dc.jpg',
                'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_9405a7346f207ef245bebb818c166eac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149429,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_f73df6b6bd7762ed1ea05f4d7fb3d68a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149429,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_357c092295596954109b58273364559a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155799,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_cd32d69d244ffbb8b0b46b9e1fe7677c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165140,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_fe7f08aca781eac6ef621d32eeba169b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166143,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_5404962057f6c5b363417efb5d1e358b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156820,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_55561d4dd76d8efb29a85c3f28dce301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163144,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_06b69aae8cb271aa994040fb30df9a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182063,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_7161d946482c8262c5b2c6f1d6f3e78e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148484,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_621fb510e343ea991fc4af01218ae0f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139991,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_a641b07f822c5e40670362e954c1cd05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141233,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_600bc444842ada98457684b265ad84cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155656,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_11a15036d5617b66c1ddd2afe80429dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1658ff-f2d3-5843-b91d-e542a9a5c3c7/2f1658ff-f2d3-5843-b91d-e542a9a5c3c7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139991,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/11/721116c17e59813278e6604db547cd73/pa/BT39914_9405a7346f207ef245bebb818c166eac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean FWD',
 'transmission': 'automatic',
 'trim': 'Ocean FWD',
 'year': 2022}
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT39914%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Saving data for BT39914: {'created_time': 1764964968.419877, 'last_price_update_time': 1764964968.41989, 'auction_closing_time': 1765037156.0}
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT39914') HTTP/1.1" 204 0
2025-12-05 20:02:48 [auto1.it] INFO: Found listing with ID: TH52637
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH52637%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Scrape type for TH52637: 0
2025-12-05 20:02:48 [auto1.it] INFO: Found listing with ID: SN76439
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN76439%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Scrape type for SN76439: 0
2025-12-05 20:02:48 [auto1.it] INFO: Found listing with ID: CB71974
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB71974%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Scrape type for CB71974: 0
2025-12-05 20:02:48 [auto1.it] INFO: Found listing with ID: BG97332
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG97332%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Scrape type for BG97332: 0
2025-12-05 20:02:48 [auto1.it] INFO: Found listing with ID: WB53951
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB53951%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Scrape type for WB53951: 0
2025-12-05 20:02:48 [auto1.it] INFO: Found listing with ID: AL52920
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL52920%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Scrape type for AL52920: 0
2025-12-05 20:02:48 [auto1.it] INFO: Found listing with ID: SZ44816
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ44816%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [auto1.it] INFO: Scrape type for SZ44816: 1
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_9049e892b314df80c47486dc259ce93f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_9049e892b314df80c47486dc259ce93f.jpg not downloaded yet
2025-12-05 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG98789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0090290>
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_5460fcfaeace2b328c5c6534b6322d91.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_5460fcfaeace2b328c5c6534b6322d91.jpg saved to cache
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_acdcd75b23411d14fd0d0c1f0368d87b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: FJ98323
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ98323%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for FJ98323: 0
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: AB72839
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB72839%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for AB72839: 0
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: CN91272
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN91272%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for CN91272: 0
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: HN76486
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN76486%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for HN76486: 0
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: CX00629
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX00629%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for CX00629: 0
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: PZ64789
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ64789%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for PZ64789: 0
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: AR79797
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR79797%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for AR79797: 0
2025-12-05 20:02:49 [auto1.it] INFO: Found listing with ID: DK98647
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK98647%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [auto1.it] INFO: Scrape type for DK98647: 1
2025-12-05 20:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_a167b489fe3252fa5781d774b50f0c64.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_a167b489fe3252fa5781d774b50f0c64.jpg not downloaded yet
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_efdc56da85d45db9175038c9d3fb5179.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_efdc56da85d45db9175038c9d3fb5179.jpg not downloaded yet
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae24ef210>
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_acdcd75b23411d14fd0d0c1f0368d87b.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_acdcd75b23411d14fd0d0c1f0368d87b.jpg saved to cache
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_48cf68b894ffb1989f74777388e04e2c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_48cf68b894ffb1989f74777388e04e2c.jpg not downloaded yet
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_e5d5e3a1975b614688c3c4150e544c75.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_40d716d08aa9e91fd2249578f48d90c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_40d716d08aa9e91fd2249578f48d90c3.jpg not downloaded yet
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE92322> (referer: https://www.auto1.com/v1/car-details-view/GE92322/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL60160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS66392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV89317/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW50433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_7339737edc6a017c25acc7931d9686a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_9049e892b314df80c47486dc259ce93f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_48cf68b894ffb1989f74777388e04e2c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_efdc56da85d45db9175038c9d3fb5179.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00c8650>
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_e5d5e3a1975b614688c3c4150e544c75.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_e5d5e3a1975b614688c3c4150e544c75.jpg saved to cache
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_a167b489fe3252fa5781d774b50f0c64.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_40d716d08aa9e91fd2249578f48d90c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_c870300bba08f73490a731ae486422d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR47123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea7addb-6098-5fc5-a544-456b7c4a39a9 with identifier: GE92322
2025-12-05 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea7addb-6098-5fc5-a544-456b7c4a39a9 with scrape type 2
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea7addb-6098-5fc5-a544-456b7c4a39a9 with scrape type 2
2025-12-05 20:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ea7addb-6098-5fc5-a544-456b7c4a39a9, identifier: GE92322
2025-12-05 20:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0472e10>
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_7339737edc6a017c25acc7931d9686a7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_7339737edc6a017c25acc7931d9686a7.jpg saved to cache
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014c950>
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_9049e892b314df80c47486dc259ce93f.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_9049e892b314df80c47486dc259ce93f.jpg saved to cache
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e2710>
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_48cf68b894ffb1989f74777388e04e2c.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_48cf68b894ffb1989f74777388e04e2c.jpg saved to cache
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0554590>
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_efdc56da85d45db9175038c9d3fb5179.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_efdc56da85d45db9175038c9d3fb5179.jpg saved to cache
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ea7addb-6098-5fc5-a544-456b7c4a39a9 with identifier: GE92322
2025-12-05 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ea7addb-6098-5fc5-a544-456b7c4a39a9 with identifier: GE92322
2025-12-05 20:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ea7addb-6098-5fc5-a544-456b7c4a39a9 with identifier: GE92322 to the API
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GE92322>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2025-12-06T16:04:01Z',
 'fuel_type': 'petrol',
 'id': '9ea7addb-6098-5fc5-a544-456b7c4a39a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE92322',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 70204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
 'transmission': 'automatic',
 'trim': 'Stepway Comfort',
 'year': 2022}
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE92322%27 HTTP/1.1" 200 None
2025-12-05 20:02:51 [auto1.it] INFO: Saving data for GE92322: {'auction_closing_time': 1765037041.0, 'created_time': 1763582668.964701, 'last_price_update_time': 1764964971.609023}
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE92322') HTTP/1.1" 204 0
2025-12-05 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF65638> (referer: https://www.auto1.com/v1/car-details-view/BF65638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP05492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03fb590>
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_a167b489fe3252fa5781d774b50f0c64.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_a167b489fe3252fa5781d774b50f0c64.jpg saved to cache
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03fbb50>
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_40d716d08aa9e91fd2249578f48d90c3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_40d716d08aa9e91fd2249578f48d90c3.jpg saved to cache
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02ec0d0>
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_c870300bba08f73490a731ae486422d7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_c870300bba08f73490a731ae486422d7.jpg saved to cache
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC45094/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM67896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS25498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR38482> (referer: https://www.auto1.com/v1/car-details-view/GR38482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d3556dc-77c2-5ec4-8f36-37ed845ebf88 with identifier: BF65638
2025-12-05 20:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d3556dc-77c2-5ec4-8f36-37ed845ebf88 with scrape type 1
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 1d3556dc-77c2-5ec4-8f36-37ed845ebf88
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_b5a9d76d66b24dec41f80342642cdc27.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_b5a9d76d66b24dec41f80342642cdc27.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_b6abf1c0d8648bfa73a033fc589b2193.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_b6abf1c0d8648bfa73a033fc589b2193.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_884740b95cc1a1d6a83ec73a9bddbb5e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_884740b95cc1a1d6a83ec73a9bddbb5e.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_fff55b62ece70a357f82badd8cbd9332.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_fff55b62ece70a357f82badd8cbd9332.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_087aad679b5191d795a174e92f513896.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_087aad679b5191d795a174e92f513896.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_7d3a744d9aa01bc8cd34c5c1035e0960.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_7d3a744d9aa01bc8cd34c5c1035e0960.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_3137af4e1bfe4282400c907a755dd734.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_3137af4e1bfe4282400c907a755dd734.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_a261cb3b79b95bc41ef0d495a84df6bd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_a261cb3b79b95bc41ef0d495a84df6bd.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_80b4dd26e8b2ec5e2645ab9ada52d364.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_80b4dd26e8b2ec5e2645ab9ada52d364.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_8e0f0eb66026c95e71e218f5b7301250.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_8e0f0eb66026c95e71e218f5b7301250.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_d75f6e26ef340522ad6fea7fa72c3c95.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_d75f6e26ef340522ad6fea7fa72c3c95.jpg already downloaded
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_1150b086824c000fc2707125460eff9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_1150b086824c000fc2707125460eff9b.jpg already downloaded
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F4d%252F724d83aefd508896699c6fe11c7e6009%252Fpa%252FBF65638_5da543be41b96e80d7424c3c398e4bc8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_5da543be41b96e80d7424c3c398e4bc8.jpg already downloaded
2025-12-05 20:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d3556dc-77c2-5ec4-8f36-37ed845ebf88, identifier: BF65638
2025-12-05 20:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d3556dc-77c2-5ec4-8f36-37ed845ebf88 with identifier: BF65638
2025-12-05 20:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d3556dc-77c2-5ec4-8f36-37ed845ebf88 with identifier: BF65638
2025-12-05 20:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
2025-12-05 20:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1d3556dc-77c2-5ec4-8f36-37ed845ebf88 spider: auto1.it
2025-12-05 20:02:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 1d3556dc-77c2-5ec4-8f36-37ed845ebf88 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:17:19Z',
 'fuel_type': 'diesel',
 'id': '1d3556dc-77c2-5ec4-8f36-37ed845ebf88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF65638',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 71714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_b5a9d76d66b24dec41f80342642cdc27.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_b6abf1c0d8648bfa73a033fc589b2193.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_884740b95cc1a1d6a83ec73a9bddbb5e.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_fff55b62ece70a357f82badd8cbd9332.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_087aad679b5191d795a174e92f513896.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_7d3a744d9aa01bc8cd34c5c1035e0960.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_3137af4e1bfe4282400c907a755dd734.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_a261cb3b79b95bc41ef0d495a84df6bd.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_80b4dd26e8b2ec5e2645ab9ada52d364.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_8e0f0eb66026c95e71e218f5b7301250.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_d75f6e26ef340522ad6fea7fa72c3c95.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_1150b086824c000fc2707125460eff9b.jpg',
                'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_5da543be41b96e80d7424c3c398e4bc8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140985,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_b5a9d76d66b24dec41f80342642cdc27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_1.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3612075,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_b6abf1c0d8648bfa73a033fc589b2193.jpg',
             'Width': 4528},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_2.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4570805,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_884740b95cc1a1d6a83ec73a9bddbb5e.jpg',
             'Width': 4528},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_fff55b62ece70a357f82badd8cbd9332.jpg',
             'Width': 722},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_4.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4693486,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_087aad679b5191d795a174e92f513896.jpg',
             'Width': 4528},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154248,
             'Height': 592,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_7d3a744d9aa01bc8cd34c5c1035e0960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148227,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_3137af4e1bfe4282400c907a755dd734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183894,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_a261cb3b79b95bc41ef0d495a84df6bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_8.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3650411,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_80b4dd26e8b2ec5e2645ab9ada52d364.jpg',
             'Width': 4528},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_9.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4724529,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_8e0f0eb66026c95e71e218f5b7301250.jpg',
             'Width': 4528},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_10.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 5097050,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_d75f6e26ef340522ad6fea7fa72c3c95.jpg',
             'Width': 4528},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_11.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4217095,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_1150b086824c000fc2707125460eff9b.jpg',
             'Width': 4528},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3556dc-77c2-5ec4-8f36-37ed845ebf88/1d3556dc-77c2-5ec4-8f36-37ed845ebf88_image_12.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4274694,
             'Height': 3016,
             'OriginUrl': 'https://img-pa.auto1.com/img72/4d/724d83aefd508896699c6fe11c7e6009/pa/BF65638_5da543be41b96e80d7424c3c398e4bc8.jpg',
             'Width': 4528}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean FWD',
 'transmission': 'automatic',
 'trim': 'Ocean FWD',
 'year': 2022}
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF65638%27 HTTP/1.1" 200 None
2025-12-05 20:02:53 [auto1.it] INFO: Saving data for BF65638: {'created_time': 1764964973.416509, 'last_price_update_time': 1764964973.41652, 'auction_closing_time': 1765037839.0}
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BF65638') HTTP/1.1" 204 0
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE73703> (referer: https://www.auto1.com/v1/car-details-view/SE73703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ44816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482
2025-12-05 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5026cd67-a342-5243-852c-db4d262c50ea with scrape type 2
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5026cd67-a342-5243-852c-db4d262c50ea with scrape type 2
2025-12-05 20:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5026cd67-a342-5243-852c-db4d262c50ea, identifier: GR38482
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_16d365bbef87bd4e84aeef1aab6344db.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482
2025-12-05 20:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482
2025-12-05 20:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5026cd67-a342-5243-852c-db4d262c50ea with identifier: GR38482 to the API
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR38482>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:45:49Z',
 'fuel_type': 'diesel',
 'id': '5026cd67-a342-5243-852c-db4d262c50ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR38482',
 'listing': 'auction',
 'location': 'IT, Modugno',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 88008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR38482%27 HTTP/1.1" 200 None
2025-12-05 20:02:54 [auto1.it] INFO: Saving data for GR38482: {'auction_closing_time': 1765039549.0, 'created_time': 1764878515.796532, 'last_price_update_time': 1764964974.018216}
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR38482') HTTP/1.1" 204 0
2025-12-05 20:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f918ba39-7364-5363-b6c3-178d22f54bea with identifier: SE73703
2025-12-05 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f918ba39-7364-5363-b6c3-178d22f54bea with scrape type 2
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f918ba39-7364-5363-b6c3-178d22f54bea with scrape type 2
2025-12-05 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f918ba39-7364-5363-b6c3-178d22f54bea, identifier: SE73703
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0531790>
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_16d365bbef87bd4e84aeef1aab6344db.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_16d365bbef87bd4e84aeef1aab6344db.jpg saved to cache
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f918ba39-7364-5363-b6c3-178d22f54bea with identifier: SE73703
2025-12-05 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f918ba39-7364-5363-b6c3-178d22f54bea with identifier: SE73703
2025-12-05 20:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f918ba39-7364-5363-b6c3-178d22f54bea with identifier: SE73703 to the API
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SE73703>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 457,
 'expiration_date': '2025-12-06T16:17:56Z',
 'fuel_type': 'petrol',
 'id': 'f918ba39-7364-5363-b6c3-178d22f54bea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE73703',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 14574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE73703%27 HTTP/1.1" 200 None
2025-12-05 20:02:54 [auto1.it] INFO: Saving data for SE73703: {'auction_closing_time': 1765037876.0, 'created_time': 1764360424.431172, 'last_price_update_time': 1764964974.750385}
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SE73703') HTTP/1.1" 204 0
2025-12-05 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK98647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA63164> (referer: https://www.auto1.com/v1/car-details-view/NA63164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK46051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH42983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC07011> (referer: https://www.auto1.com/v1/car-details-view/ZC07011/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_36aad7827648b1de2445523201873ffb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7 with identifier: NA63164
2025-12-05 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7 with scrape type 1
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_9033dc1a71c448b820ba80f126e001e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_9033dc1a71c448b820ba80f126e001e4.jpg already downloaded
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_ba4be278949af90fc1ea8e002f007444.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_ba4be278949af90fc1ea8e002f007444.jpg already downloaded
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_5c603e0149b6dbdb0b0253bd5eabb9c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_5c603e0149b6dbdb0b0253bd5eabb9c0.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_224f60dde6ef30c7cb3d7213fe525a96.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_224f60dde6ef30c7cb3d7213fe525a96.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_bc03a9bef856930a9463e9d953e7dd2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_bc03a9bef856930a9463e9d953e7dd2f.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_68a5689305f56e4587e578ce2ede6398.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_68a5689305f56e4587e578ce2ede6398.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_fab5d9ebfab37715d920fbb7519ba555.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_fab5d9ebfab37715d920fbb7519ba555.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_724ed14d3272ea965f73ef3b6f7d4360.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_724ed14d3272ea965f73ef3b6f7d4360.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_3f3d528ec1efb5e639a34f4b5fcf0389.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_3f3d528ec1efb5e639a34f4b5fcf0389.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_81aa4ea69fff241b55a11a053ff427b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_81aa4ea69fff241b55a11a053ff427b7.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_412dd488b68c81c4860dd20bf9859145.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_412dd488b68c81c4860dd20bf9859145.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_19a72dc316b1e293ca5babd74c88df09.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_19a72dc316b1e293ca5babd74c88df09.jpg already downloaded
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fda%252Fa2dad7779ce31893073c9db873b7eb77%252Fpa%252FNA63164_4b7771a65ee49a35bb8979bf7d16607e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_4b7771a65ee49a35bb8979bf7d16607e.jpg already downloaded
2025-12-05 20:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7, identifier: NA63164
2025-12-05 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7 with identifier: NA63164
2025-12-05 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7 with identifier: NA63164
2025-12-05 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2025-12-05 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7 spider: auto1.it
2025-12-05 20:02:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:14:57Z',
 'fuel_type': 'diesel',
 'id': '57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA63164',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 80766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_9033dc1a71c448b820ba80f126e001e4.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_ba4be278949af90fc1ea8e002f007444.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_5c603e0149b6dbdb0b0253bd5eabb9c0.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_224f60dde6ef30c7cb3d7213fe525a96.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_bc03a9bef856930a9463e9d953e7dd2f.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_68a5689305f56e4587e578ce2ede6398.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_fab5d9ebfab37715d920fbb7519ba555.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_724ed14d3272ea965f73ef3b6f7d4360.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_3f3d528ec1efb5e639a34f4b5fcf0389.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_81aa4ea69fff241b55a11a053ff427b7.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_412dd488b68c81c4860dd20bf9859145.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_19a72dc316b1e293ca5babd74c88df09.jpg',
                'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_4b7771a65ee49a35bb8979bf7d16607e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_9033dc1a71c448b820ba80f126e001e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3053020,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_ba4be278949af90fc1ea8e002f007444.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_5c603e0149b6dbdb0b0253bd5eabb9c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524052,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_224f60dde6ef30c7cb3d7213fe525a96.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_bc03a9bef856930a9463e9d953e7dd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793436,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_68a5689305f56e4587e578ce2ede6398.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882805,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_fab5d9ebfab37715d920fbb7519ba555.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853718,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_724ed14d3272ea965f73ef3b6f7d4360.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449865,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_3f3d528ec1efb5e639a34f4b5fcf0389.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_81aa4ea69fff241b55a11a053ff427b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_412dd488b68c81c4860dd20bf9859145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_19a72dc316b1e293ca5babd74c88df09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7/57b8d2b1-2a2b-5b18-a1f7-1e9ca6b459a7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2780418,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/da/a2dad7779ce31893073c9db873b7eb77/pa/NA63164_4b7771a65ee49a35bb8979bf7d16607e.jpg',
             'Width': 4032}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H1 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H1 RS: 3450 mm',
 'year': 2023}
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA63164%27 HTTP/1.1" 200 None
2025-12-05 20:02:55 [auto1.it] INFO: Saving data for NA63164: {'created_time': 1764964975.618396, 'last_price_update_time': 1764964975.618406, 'auction_closing_time': 1765037697.0}
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA63164') HTTP/1.1" 204 0
2025-12-05 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ21279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA95207> (referer: https://www.auto1.com/v1/car-details-view/UA95207/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b978523-6607-5c79-90dd-b2f185622aca with identifier: ZC07011
2025-12-05 20:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b978523-6607-5c79-90dd-b2f185622aca with scrape type 2
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b978523-6607-5c79-90dd-b2f185622aca with scrape type 2
2025-12-05 20:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b978523-6607-5c79-90dd-b2f185622aca, identifier: ZC07011
2025-12-05 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0199610>
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F22%252Fad22e4629540d311a34dfe00b7811256%252Fpa%252FME55012_36aad7827648b1de2445523201873ffb.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_36aad7827648b1de2445523201873ffb.jpg saved to cache
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb
2025-12-05 20:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bb78844-bb2b-58ee-bf18-b08ad29086bb, skipping ID generation
2025-12-05 20:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb with scrape type 1
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8bb78844-bb2b-58ee-bf18-b08ad29086bb from tracking dictionaries
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bb78844-bb2b-58ee-bf18-b08ad29086bb sending to next pipeline
2025-12-05 20:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8bb78844-bb2b-58ee-bf18-b08ad29086bb, identifier: ME55012
2025-12-05 20:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b978523-6607-5c79-90dd-b2f185622aca with identifier: ZC07011
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2025-12-05 20:02:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b978523-6607-5c79-90dd-b2f185622aca with identifier: ZC07011
2025-12-05 20:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b978523-6607-5c79-90dd-b2f185622aca with identifier: ZC07011 to the API
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC07011>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2025-12-06T16:32:59Z',
 'fuel_type': 'hybrid',
 'id': '7b978523-6607-5c79-90dd-b2f185622aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC07011',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 59958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 2.0 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2021}
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC07011%27 HTTP/1.1" 200 None
2025-12-05 20:02:57 [auto1.it] INFO: Saving data for ZC07011: {'auction_closing_time': 1765038779.0, 'created_time': 1764360383.360578, 'last_price_update_time': 1764964977.751584}
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC07011') HTTP/1.1" 204 0
2025-12-05 20:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8bb78844-bb2b-58ee-bf18-b08ad29086bb with identifier: ME55012
2025-12-05 20:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8bb78844-bb2b-58ee-bf18-b08ad29086bb with identifier: ME55012
2025-12-05 20:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8bb78844-bb2b-58ee-bf18-b08ad29086bb with identifier: ME55012 to the API
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_36aad7827648b1de2445523201873ffb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2025-12-06T16:05:19Z',
 'fuel_type': 'petrol',
 'id': '8bb78844-bb2b-58ee-bf18-b08ad29086bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME55012',
 'listing': 'auction',
 'location': 'IT, Massa',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 26486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_b9f8d3898218aa694926acbca2ccad3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_42d25e2d1f749c4ddefa34a10f8dd339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_224dc676c9410d24346da467d9094138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_5460fcfaeace2b328c5c6534b6322d91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_7339737edc6a017c25acc7931d9686a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_36aad7827648b1de2445523201873ffb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_16d365bbef87bd4e84aeef1aab6344db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_acdcd75b23411d14fd0d0c1f0368d87b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_c870300bba08f73490a731ae486422d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_e5d5e3a1975b614688c3c4150e544c75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_9049e892b314df80c47486dc259ce93f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_a167b489fe3252fa5781d774b50f0c64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_efdc56da85d45db9175038c9d3fb5179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_48cf68b894ffb1989f74777388e04e2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb78844-bb2b-58ee-bf18-b08ad29086bb/8bb78844-bb2b-58ee-bf18-b08ad29086bb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/22/ad22e4629540d311a34dfe00b7811256/pa/ME55012_40d716d08aa9e91fd2249578f48d90c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P200 Mild-Hybrid AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2022}
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME55012%27 HTTP/1.1" 200 None
2025-12-05 20:02:58 [auto1.it] INFO: Saving data for ME55012: {'created_time': 1764964978.731889, 'last_price_update_time': 1764964978.731899, 'auction_closing_time': 1765037119.0}
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME55012') HTTP/1.1" 204 0
2025-12-05 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG98789> (referer: https://www.auto1.com/v1/car-details-view/HG98789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827ca40c-0574-59cc-9a74-7594560a791f with identifier: UA95207
2025-12-05 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827ca40c-0574-59cc-9a74-7594560a791f with scrape type 2
2025-12-05 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827ca40c-0574-59cc-9a74-7594560a791f with scrape type 2
2025-12-05 20:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 827ca40c-0574-59cc-9a74-7594560a791f, identifier: UA95207
2025-12-05 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 827ca40c-0574-59cc-9a74-7594560a791f with identifier: UA95207
2025-12-05 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 827ca40c-0574-59cc-9a74-7594560a791f with identifier: UA95207
2025-12-05 20:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 827ca40c-0574-59cc-9a74-7594560a791f with identifier: UA95207 to the API
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA95207>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:15:55Z',
 'fuel_type': 'diesel',
 'id': '827ca40c-0574-59cc-9a74-7594560a791f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA95207',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'BMW',
 'model': '5er',
 'odometer': 81615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA95207%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [auto1.it] INFO: Saving data for UA95207: {'auction_closing_time': 1765037755.0, 'created_time': 1764014891.131459, 'last_price_update_time': 1764964979.222643}
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA95207') HTTP/1.1" 204 0
2025-12-05 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 870051fc-cabf-5061-8f18-4a80deb14b94 with identifier: HG98789
2025-12-05 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870051fc-cabf-5061-8f18-4a80deb14b94 with scrape type 1
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_9adb9cb83d21927a6acdc433a90e6957.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_9adb9cb83d21927a6acdc433a90e6957.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_98b7fd35771a5be82714a59138c8bb77.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_98b7fd35771a5be82714a59138c8bb77.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_91d1928730980f1507f3b173bc8fb988.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_91d1928730980f1507f3b173bc8fb988.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_efa8827e609f43458903107c54fa3035.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_efa8827e609f43458903107c54fa3035.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_937d1c84cc9cea3bb976d526b7b62c8c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_937d1c84cc9cea3bb976d526b7b62c8c.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_64ac8490cfe22350151ebd16a8ed261f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_64ac8490cfe22350151ebd16a8ed261f.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_d1742ad668ccf61af144e74494ba4f85.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_d1742ad668ccf61af144e74494ba4f85.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_1fb92324b5657432378230dca94e3134.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_1fb92324b5657432378230dca94e3134.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_3ff8b052e66a377adee2da3b28299d27.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_3ff8b052e66a377adee2da3b28299d27.jpg not downloaded yet
2025-12-05 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV89317> (referer: https://www.auto1.com/v1/car-details-view/EV89317/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_fee4dae5d21a6d75e35579fbc43fb808.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_fee4dae5d21a6d75e35579fbc43fb808.jpg not downloaded yet
2025-12-05 20:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_5530757f705a43f37ffca27d17e975af.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_5530757f705a43f37ffca27d17e975af.jpg not downloaded yet
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_a393caac1cfa5f057f799d72d614c486.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_a393caac1cfa5f057f799d72d614c486.jpg not downloaded yet
2025-12-05 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR47123> (referer: https://www.auto1.com/v1/car-details-view/PR47123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_e2baad63f0abc89b018b48c1a296148b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_e2baad63f0abc89b018b48c1a296148b.jpg not downloaded yet
2025-12-05 20:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL60160> (referer: https://www.auto1.com/v1/car-details-view/BL60160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_6aaf9152010f06520fbd2b246a65daf2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_6aaf9152010f06520fbd2b246a65daf2.jpg not downloaded yet
2025-12-05 20:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f68ca85-e0a9-5a13-845a-5b77e2328d69 with identifier: EV89317
2025-12-05 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f68ca85-e0a9-5a13-845a-5b77e2328d69 with scrape type 2
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f68ca85-e0a9-5a13-845a-5b77e2328d69 with scrape type 2
2025-12-05 20:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6f68ca85-e0a9-5a13-845a-5b77e2328d69, identifier: EV89317
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_875fb1d6cb1d10c981d358bafead1b38.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_875fb1d6cb1d10c981d358bafead1b38.jpg not downloaded yet
2025-12-05 20:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6f68ca85-e0a9-5a13-845a-5b77e2328d69 with identifier: EV89317
2025-12-05 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6f68ca85-e0a9-5a13-845a-5b77e2328d69 with identifier: EV89317
2025-12-05 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149301 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149301
2025-12-05 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 6f68ca85-e0a9-5a13-845a-5b77e2328d69 spider: auto1.it
2025-12-05 20:03:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 6f68ca85-e0a9-5a13-845a-5b77e2328d69 due to rule: high_mileage_for_make.json, error: 149301 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149301
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:58:04Z',
 'fuel_type': 'diesel',
 'id': '6f68ca85-e0a9-5a13-845a-5b77e2328d69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV89317',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 149301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2020}
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV89317%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [auto1.it] INFO: Saving data for EV89317: {'auction_closing_time': 1765040284.0, 'created_time': 1764878454.194299, 'last_price_update_time': 1764964980.106906}
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV89317') HTTP/1.1" 204 0
2025-12-05 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_e2baad63f0abc89b018b48c1a296148b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW50433> (referer: https://www.auto1.com/v1/car-details-view/ZW50433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF80780> (referer: https://www.auto1.com/v1/car-details-view/TF80780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d with identifier: PR47123
2025-12-05 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d with scrape type 2
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d with scrape type 2
2025-12-05 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d, identifier: PR47123
2025-12-05 20:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8939084f-70d2-5cab-b1e4-dd423c258621 with identifier: BL60160
2025-12-05 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8939084f-70d2-5cab-b1e4-dd423c258621 with scrape type 1
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 8939084f-70d2-5cab-b1e4-dd423c258621
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_a8992819f76f059cc1fe47f3127c8830.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_a8992819f76f059cc1fe47f3127c8830.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_e4404132dc1a38de92a8f64fed7472db.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_e4404132dc1a38de92a8f64fed7472db.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_bc96e3967a06e72d72b8400661be7edf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_bc96e3967a06e72d72b8400661be7edf.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_510dacc986403eb9674f667d940324ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_510dacc986403eb9674f667d940324ea.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_3a1c343259da3fa5fa19bbf3c4516812.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_3a1c343259da3fa5fa19bbf3c4516812.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_15c879072bab39c76cf04050c8d5fd79.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_15c879072bab39c76cf04050c8d5fd79.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_a6bc065359875e9c6909343398693dca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_a6bc065359875e9c6909343398693dca.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_b2afc47ebedf539d41ade92310865870.png%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_b2afc47ebedf539d41ade92310865870.png already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_5740402e33f4ca989b64ea02895e41bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_5740402e33f4ca989b64ea02895e41bb.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_4fb28b61783e7ab03caf2fcf639883ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_4fb28b61783e7ab03caf2fcf639883ce.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_d6936239a0a3daa33ed630a1e5478a95.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_d6936239a0a3daa33ed630a1e5478a95.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_e2b10cc02658d357bcfd0e3811f5f406.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_e2b10cc02658d357bcfd0e3811f5f406.jpg already downloaded
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb1%252Fa4b1972a18b462fdc55173698105af05%252Fpa%252FBL60160_cf83b6e84bf068cd7565cb08ffc36397.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_cf83b6e84bf068cd7565cb08ffc36397.jpg already downloaded
2025-12-05 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8939084f-70d2-5cab-b1e4-dd423c258621, identifier: BL60160
2025-12-05 20:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d with identifier: PR47123
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d with identifier: PR47123
2025-12-05 20:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d with identifier: PR47123 to the API
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR47123>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 218,
 'expiration_date': '2025-12-06T16:39:06Z',
 'fuel_type': 'electro',
 'id': '1c9dcf9b-0e9f-531c-95c9-fa0de3c8205d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR47123',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Renault',
 'model': 'Megane E-Tech',
 'odometer': 18296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane E-Tech EV60 Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2024}
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR47123%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [auto1.it] INFO: Saving data for PR47123: {'auction_closing_time': 1765039146.0, 'created_time': 1764878442.293523, 'last_price_update_time': 1764964981.150997}
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR47123') HTTP/1.1" 204 0
2025-12-05 20:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8939084f-70d2-5cab-b1e4-dd423c258621 with identifier: BL60160
2025-12-05 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8939084f-70d2-5cab-b1e4-dd423c258621 with identifier: BL60160
2025-12-05 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2025-12-05 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8939084f-70d2-5cab-b1e4-dd423c258621 spider: auto1.it
2025-12-05 20:03:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8939084f-70d2-5cab-b1e4-dd423c258621 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:23:36Z',
 'fuel_type': 'diesel',
 'id': '8939084f-70d2-5cab-b1e4-dd423c258621',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL60160',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 98265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_a8992819f76f059cc1fe47f3127c8830.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_e4404132dc1a38de92a8f64fed7472db.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_bc96e3967a06e72d72b8400661be7edf.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_510dacc986403eb9674f667d940324ea.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_3a1c343259da3fa5fa19bbf3c4516812.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_15c879072bab39c76cf04050c8d5fd79.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_a6bc065359875e9c6909343398693dca.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_b2afc47ebedf539d41ade92310865870.png',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_5740402e33f4ca989b64ea02895e41bb.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_4fb28b61783e7ab03caf2fcf639883ce.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_d6936239a0a3daa33ed630a1e5478a95.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_e2b10cc02658d357bcfd0e3811f5f406.jpg',
                'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_cf83b6e84bf068cd7565cb08ffc36397.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_a8992819f76f059cc1fe47f3127c8830.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_e4404132dc1a38de92a8f64fed7472db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_bc96e3967a06e72d72b8400661be7edf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_510dacc986403eb9674f667d940324ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_3a1c343259da3fa5fa19bbf3c4516812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_15c879072bab39c76cf04050c8d5fd79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_a6bc065359875e9c6909343398693dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 328508,
             'Height': 244,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_b2afc47ebedf539d41ade92310865870.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_5740402e33f4ca989b64ea02895e41bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_4fb28b61783e7ab03caf2fcf639883ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_d6936239a0a3daa33ed630a1e5478a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_e2b10cc02658d357bcfd0e3811f5f406.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939084f-70d2-5cab-b1e4-dd423c258621/8939084f-70d2-5cab-b1e4-dd423c258621_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/b1/a4b1972a18b462fdc55173698105af05/pa/BL60160_cf83b6e84bf068cd7565cb08ffc36397.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet 33 L3H2 Hochdach verblecht',
 'transmission': 'manual',
 'trim': '33 L3H2 Hochdach verblecht',
 'year': 2023}
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL60160%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [auto1.it] INFO: Saving data for BL60160: {'created_time': 1764964981.384405, 'last_price_update_time': 1764964981.384418, 'auction_closing_time': 1765038216.0}
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL60160') HTTP/1.1" 204 0
2025-12-05 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS25498> (referer: https://www.auto1.com/v1/car-details-view/YS25498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS66392> (referer: https://www.auto1.com/v1/car-details-view/TS66392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ44816> (referer: https://www.auto1.com/v1/car-details-view/SZ44816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP05492> (referer: https://www.auto1.com/v1/car-details-view/PP05492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0530910>
2025-12-05 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_e2baad63f0abc89b018b48c1a296148b.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_e2baad63f0abc89b018b48c1a296148b.jpg saved to cache
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a175f64-f14c-5ede-9a2c-499ce8b056d5 with identifier: ZW50433
2025-12-05 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a175f64-f14c-5ede-9a2c-499ce8b056d5 with scrape type 2
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a175f64-f14c-5ede-9a2c-499ce8b056d5 with scrape type 2
2025-12-05 20:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a175f64-f14c-5ede-9a2c-499ce8b056d5, identifier: ZW50433
2025-12-05 20:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27d7adef-0498-5f72-b853-df46bebd2e5d with identifier: TF80780
2025-12-05 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d7adef-0498-5f72-b853-df46bebd2e5d with scrape type 2
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27d7adef-0498-5f72-b853-df46bebd2e5d with scrape type 2
2025-12-05 20:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27d7adef-0498-5f72-b853-df46bebd2e5d, identifier: TF80780
2025-12-05 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a175f64-f14c-5ede-9a2c-499ce8b056d5 with identifier: ZW50433
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2025-12-05 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a175f64-f14c-5ede-9a2c-499ce8b056d5 with identifier: ZW50433
2025-12-05 20:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a175f64-f14c-5ede-9a2c-499ce8b056d5 with identifier: ZW50433 to the API
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZW50433>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:38:43Z',
 'fuel_type': 'petrol',
 'id': '4a175f64-f14c-5ede-9a2c-499ce8b056d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW50433',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 48984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 E-torQ Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2018}
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW50433%27 HTTP/1.1" 200 None
2025-12-05 20:03:02 [auto1.it] INFO: Saving data for ZW50433: {'auction_closing_time': 1765039123.0, 'created_time': 1764878432.809599, 'last_price_update_time': 1764964982.56472}
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZW50433') HTTP/1.1" 204 0
2025-12-05 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27d7adef-0498-5f72-b853-df46bebd2e5d with identifier: TF80780
2025-12-05 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27d7adef-0498-5f72-b853-df46bebd2e5d with identifier: TF80780
2025-12-05 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146705 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146705
2025-12-05 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 27d7adef-0498-5f72-b853-df46bebd2e5d spider: auto1.it
2025-12-05 20:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 27d7adef-0498-5f72-b853-df46bebd2e5d due to rule: high_mileage_for_make.json, error: 146705 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146705
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:25:42Z',
 'fuel_type': 'diesel',
 'id': '27d7adef-0498-5f72-b853-df46bebd2e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF80780',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 146705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF80780%27 HTTP/1.1" 200 None
2025-12-05 20:03:02 [auto1.it] INFO: Saving data for TF80780: {'auction_closing_time': 1765038342.0, 'created_time': 1764878541.855455, 'last_price_update_time': 1764964982.876251}
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF80780') HTTP/1.1" 204 0
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_5530757f705a43f37ffca27d17e975af.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_875fb1d6cb1d10c981d358bafead1b38.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM67896> (referer: https://www.auto1.com/v1/car-details-view/PM67896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC45094> (referer: https://www.auto1.com/v1/car-details-view/MC45094/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a65f1d3-9db1-5343-ac05-5a1395513735 with identifier: YS25498
2025-12-05 20:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a65f1d3-9db1-5343-ac05-5a1395513735 with scrape type 2
2025-12-05 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a65f1d3-9db1-5343-ac05-5a1395513735 with scrape type 2
2025-12-05 20:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a65f1d3-9db1-5343-ac05-5a1395513735, identifier: YS25498
2025-12-05 20:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 with identifier: TS66392
2025-12-05 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 with scrape type 1
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_e59fc9a8d5952317994b68b4458ae80e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e59fc9a8d5952317994b68b4458ae80e.jpg not downloaded yet
2025-12-05 20:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e478d6-98e6-5133-95e5-eaccff52e990 with identifier: SZ44816
2025-12-05 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e478d6-98e6-5133-95e5-eaccff52e990 with scrape type 1
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_462ba32fcc580249a087c118267c8deb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_462ba32fcc580249a087c118267c8deb.jpg not downloaded yet
2025-12-05 20:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492
2025-12-05 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6950582b-8a41-59e4-8a8d-9e2a94de413d with scrape type 2
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6950582b-8a41-59e4-8a8d-9e2a94de413d with scrape type 2
2025-12-05 20:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6950582b-8a41-59e4-8a8d-9e2a94de413d, identifier: PP05492
2025-12-05 20:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a65f1d3-9db1-5343-ac05-5a1395513735 with identifier: YS25498
2025-12-05 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a65f1d3-9db1-5343-ac05-5a1395513735 with identifier: YS25498
2025-12-05 20:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a65f1d3-9db1-5343-ac05-5a1395513735 with identifier: YS25498 to the API
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS25498>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:17:39Z',
 'fuel_type': 'diesel',
 'id': '7a65f1d3-9db1-5343-ac05-5a1395513735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS25498',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 95036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2017}
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS25498%27 HTTP/1.1" 200 None
2025-12-05 20:03:03 [auto1.it] INFO: Saving data for YS25498: {'auction_closing_time': 1765037859.0, 'created_time': 1764360347.856373, 'last_price_update_time': 1764964983.656366}
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YS25498') HTTP/1.1" 204 0
2025-12-05 20:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492
2025-12-05 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492
2025-12-05 20:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492 to the API
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PP05492>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 351,
 'expiration_date': '2025-12-06T16:31:48Z',
 'fuel_type': 'diesel',
 'id': '6950582b-8a41-59e4-8a8d-9e2a94de413d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP05492',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 78736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP05492%27 HTTP/1.1" 200 None
2025-12-05 20:03:04 [auto1.it] INFO: Saving data for PP05492: {'auction_closing_time': 1765038708.0, 'created_time': 1763107250.628935, 'last_price_update_time': 1764964984.132702}
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP05492') HTTP/1.1" 204 0
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_062ae7084e508f8f7e51b971cec1d391.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_062ae7084e508f8f7e51b971cec1d391.jpg not downloaded yet
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_dd8150cd38344e01ff0eac810c3394a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dd8150cd38344e01ff0eac810c3394a7.jpg not downloaded yet
2025-12-05 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ17283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL18907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae057b190>
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_5530757f705a43f37ffca27d17e975af.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_5530757f705a43f37ffca27d17e975af.jpg saved to cache
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae057a9d0>
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_875fb1d6cb1d10c981d358bafead1b38.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_875fb1d6cb1d10c981d358bafead1b38.jpg saved to cache
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a24f290-24ad-5acf-9af6-f4874189d387 with identifier: PM67896
2025-12-05 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a24f290-24ad-5acf-9af6-f4874189d387 with scrape type 2
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a24f290-24ad-5acf-9af6-f4874189d387 with scrape type 2
2025-12-05 20:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a24f290-24ad-5acf-9af6-f4874189d387, identifier: PM67896
2025-12-05 20:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6782350-6e05-5c36-9e31-63ae63ad2eae with identifier: MC45094
2025-12-05 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6782350-6e05-5c36-9e31-63ae63ad2eae with scrape type 1
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_c3b83ed9e25473c2fc40863323c7c582.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c3b83ed9e25473c2fc40863323c7c582.jpg not downloaded yet
2025-12-05 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_64ac8490cfe22350151ebd16a8ed261f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_4be42652622b7d3454123c9be251c684.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_4be42652622b7d3454123c9be251c684.jpg not downloaded yet
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_689f18c5642787f9654bfb4bf389d0be.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_689f18c5642787f9654bfb4bf389d0be.jpg not downloaded yet
2025-12-05 20:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a24f290-24ad-5acf-9af6-f4874189d387 with identifier: PM67896
2025-12-05 20:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a24f290-24ad-5acf-9af6-f4874189d387 with identifier: PM67896
2025-12-05 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong rexton sports 2.2 td xl dream 4wd', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'rexton sports', 'transmission': 'manual', 'odometer': 71003, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pm67896', 'expiration_date': '2025-12-06t16:41:22z', 'origin_country_code': 'it', 'trim': 'xl dream 4wd', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '2.2l', 'location': 'it, piacenza', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 237, 'id': '3a24f290-24ad-5acf-9af6-f4874189d387', 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'ssangyong rexton sports', 'sanitized_make': 'ssangyong', 'odometer_in_km': 71003}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': 237,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 4,
     'emission_standard': 'euro 6d-temp',
     'engine': '2.2l',
     'engine_horse_power': 181,
     'expiration_date': '2025-12-06t16:41:22z',
     'fuel_type': 'diesel',
     'id': '3a24f290-24ad-5acf-9af6-f4874189d387',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pm67896',
     'listing': 'auction',
     'location': 'it, piacenza',
     'make': 'ssangyong',
     'make_model': 'ssangyong rexton sports',
     'model': 'rexton sports',
     'odometer': 71003,
     'odometer_in_km': 71003,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-20',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong rexton sports 2.2 td xl dream 4wd',
     'transmission': 'manual',
     'trim': 'xl dream 4wd',
     'year': 2022}
2025-12-05 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 3a24f290-24ad-5acf-9af6-f4874189d387 spider: auto1.it
2025-12-05 20:03:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3a24f290-24ad-5acf-9af6-f4874189d387 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong rexton sports 2.2 td xl dream 4wd', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'rexton sports', 'transmission': 'manual', 'odometer': 71003, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pm67896', 'expiration_date': '2025-12-06t16:41:22z', 'origin_country_code': 'it', 'trim': 'xl dream 4wd', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '2.2l', 'location': 'it, piacenza', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 237, 'id': '3a24f290-24ad-5acf-9af6-f4874189d387', 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'ssangyong rexton sports', 'sanitized_make': 'ssangyong', 'odometer_in_km': 71003}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': 237,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 4,
     'emission_standard': 'euro 6d-temp',
     'engine': '2.2l',
     'engine_horse_power': 181,
     'expiration_date': '2025-12-06t16:41:22z',
     'fuel_type': 'diesel',
     'id': '3a24f290-24ad-5acf-9af6-f4874189d387',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pm67896',
     'listing': 'auction',
     'location': 'it, piacenza',
     'make': 'ssangyong',
     'make_model': 'ssangyong rexton sports',
     'model': 'rexton sports',
     'odometer': 71003,
     'odometer_in_km': 71003,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-20',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong rexton sports 2.2 td xl dream 4wd',
     'transmission': 'manual',
     'trim': 'xl dream 4wd',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.2L',
 'engine_horse_power': 181,
 'expiration_date': '2025-12-06T16:41:22Z',
 'fuel_type': 'diesel',
 'id': '3a24f290-24ad-5acf-9af6-f4874189d387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM67896',
 'listing': 'auction',
 'location': 'IT, Piacenza',
 'make': 'Ssangyong',
 'model': 'Rexton Sports',
 'odometer': 71003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Rexton Sports 2.2 TD XL Dream 4WD',
 'transmission': 'manual',
 'trim': 'XL Dream 4WD',
 'year': 2022}
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM67896%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [auto1.it] INFO: Saving data for PM67896: {'auction_closing_time': 1765039282.0, 'created_time': 1764878519.672242, 'last_price_update_time': 1764964985.24266}
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM67896') HTTP/1.1" 204 0
2025-12-05 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_937d1c84cc9cea3bb976d526b7b62c8c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_6a25d3c3e9fb3ab542944bd4ac20b11f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_6a25d3c3e9fb3ab542944bd4ac20b11f.jpg not downloaded yet
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_ff274d57ee5ea18730978a862ba5ad41.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ff274d57ee5ea18730978a862ba5ad41.jpg not downloaded yet
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_993312d608979c0b3491b0d4c52714d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_993312d608979c0b3491b0d4c52714d6.jpg not downloaded yet
2025-12-05 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH42983> (referer: https://www.auto1.com/v1/car-details-view/DH42983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK46051> (referer: https://www.auto1.com/v1/car-details-view/CK46051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK98647> (referer: https://www.auto1.com/v1/car-details-view/DK98647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_c020fe4d6963e5d35bd79871d4414c36.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c020fe4d6963e5d35bd79871d4414c36.jpg not downloaded yet
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_357efcdfe24427915327f7ddf6222334.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_357efcdfe24427915327f7ddf6222334.jpg not downloaded yet
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_c69aebee53b48ea89186f677c8405281.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c69aebee53b48ea89186f677c8405281.jpg not downloaded yet
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae020c790>
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_64ac8490cfe22350151ebd16a8ed261f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_64ac8490cfe22350151ebd16a8ed261f.jpg saved to cache
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_ab16e960463fd12cc4e3565d36876690.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_ab16e960463fd12cc4e3565d36876690.jpg not downloaded yet
2025-12-05 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_efa8827e609f43458903107c54fa3035.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_faea69edf8a8a0a4693dd776a6382bee.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_faea69edf8a8a0a4693dd776a6382bee.jpg not downloaded yet
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_594978582f35e0e6340aebdad114b772.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_594978582f35e0e6340aebdad114b772.jpg not downloaded yet
2025-12-05 20:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae240d190>
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_937d1c84cc9cea3bb976d526b7b62c8c.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_937d1c84cc9cea3bb976d526b7b62c8c.jpg saved to cache
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_91d1928730980f1507f3b173bc8fb988.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_8bb9fd1ded033e22b3addf20e7ef6709.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bb9fd1ded033e22b3addf20e7ef6709.jpg not downloaded yet
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_7357861b0c58227ec75dfc1c09ea0805.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_7357861b0c58227ec75dfc1c09ea0805.jpg not downloaded yet
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_0887a7049e68dd7a90af166a85be2d30.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_0887a7049e68dd7a90af166a85be2d30.jpg not downloaded yet
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_8bd13e3f191733b9f370524e71c9ef3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bd13e3f191733b9f370524e71c9ef3a.jpg not downloaded yet
2025-12-05 20:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ec1d0ec-dbff-5455-a4a4-8b4c70540190 with identifier: DH42983
2025-12-05 20:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ec1d0ec-dbff-5455-a4a4-8b4c70540190 with scrape type 2
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ec1d0ec-dbff-5455-a4a4-8b4c70540190 with scrape type 2
2025-12-05 20:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3ec1d0ec-dbff-5455-a4a4-8b4c70540190, identifier: DH42983
2025-12-05 20:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9613045a-cd47-58b2-9d95-dc59f34b6d34 with identifier: CK46051
2025-12-05 20:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9613045a-cd47-58b2-9d95-dc59f34b6d34 with scrape type 2
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9613045a-cd47-58b2-9d95-dc59f34b6d34 with scrape type 2
2025-12-05 20:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9613045a-cd47-58b2-9d95-dc59f34b6d34, identifier: CK46051
2025-12-05 20:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 with identifier: DK98647
2025-12-05 20:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 with scrape type 1
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_e84e34a1855f422344cac564deb643c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_e84e34a1855f422344cac564deb643c6.jpg not downloaded yet
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f3350>
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_efa8827e609f43458903107c54fa3035.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_efa8827e609f43458903107c54fa3035.jpg saved to cache
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_cc659dafcf35b4c4395e5239cde81b12.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_cc659dafcf35b4c4395e5239cde81b12.jpg not downloaded yet
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_26271666391c88c65e6be912d5474954.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_26271666391c88c65e6be912d5474954.jpg not downloaded yet
2025-12-05 20:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3ec1d0ec-dbff-5455-a4a4-8b4c70540190 with identifier: DH42983
2025-12-05 20:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3ec1d0ec-dbff-5455-a4a4-8b4c70540190 with identifier: DH42983
2025-12-05 20:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2025-12-05 20:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3ec1d0ec-dbff-5455-a4a4-8b4c70540190 spider: auto1.it
2025-12-05 20:03:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3ec1d0ec-dbff-5455-a4a4-8b4c70540190 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:50:02Z',
 'fuel_type': 'diesel',
 'id': '3ec1d0ec-dbff-5455-a4a4-8b4c70540190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH42983',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 40092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2022}
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH42983%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [auto1.it] INFO: Saving data for DH42983: {'auction_closing_time': 1765039802.0, 'created_time': 1763107241.560584, 'last_price_update_time': 1764964987.084756}
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DH42983') HTTP/1.1" 204 0
2025-12-05 20:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9613045a-cd47-58b2-9d95-dc59f34b6d34 with identifier: CK46051
2025-12-05 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9613045a-cd47-58b2-9d95-dc59f34b6d34 with identifier: CK46051
2025-12-05 20:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9613045a-cd47-58b2-9d95-dc59f34b6d34 with identifier: CK46051 to the API
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK46051>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2025-12-06T16:55:33Z',
 'fuel_type': 'diesel',
 'id': '9613045a-cd47-58b2-9d95-dc59f34b6d34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK46051',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 109022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK46051%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [auto1.it] INFO: Saving data for CK46051: {'auction_closing_time': 1765040133.0, 'created_time': 1762254483.722333, 'last_price_update_time': 1764964987.48896}
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK46051') HTTP/1.1" 204 0
2025-12-05 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c3b83ed9e25473c2fc40863323c7c582.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_7d6c2d08ce62155b87e7e689104245b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_7d6c2d08ce62155b87e7e689104245b5.jpg not downloaded yet
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_4bb67c62bb9eef009a8a8d7fb53f3229.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4bb67c62bb9eef009a8a8d7fb53f3229.jpg not downloaded yet
2025-12-05 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_98b7fd35771a5be82714a59138c8bb77.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_57bd1ab0e3f1cfa5dc6953a792d531f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_57bd1ab0e3f1cfa5dc6953a792d531f8.jpg not downloaded yet
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_d07925c3599093fc79ccfc7fcc8ebe0d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_d07925c3599093fc79ccfc7fcc8ebe0d.jpg not downloaded yet
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0555850>
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_91d1928730980f1507f3b173bc8fb988.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_91d1928730980f1507f3b173bc8fb988.jpg saved to cache
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_bb2fc12fb65e8fd7275a853db5d999d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_bb2fc12fb65e8fd7275a853db5d999d1.jpg not downloaded yet
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_4b233e31da3b6a3578a5303582df0c17.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b233e31da3b6a3578a5303582df0c17.jpg not downloaded yet
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_e7676363f23cb9f3c5c74f3db737242b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e7676363f23cb9f3c5c74f3db737242b.jpg not downloaded yet
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_4c1d605be35214b278e276435e992c96.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_4c1d605be35214b278e276435e992c96.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_2963e5007b72a5b1d94e56f57be6047c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_2963e5007b72a5b1d94e56f57be6047c.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_4b3a5fc580d29db6d1566d50e9bf3b9a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b3a5fc580d29db6d1566d50e9bf3b9a.jpg not downloaded yet
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04d7f90>
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_c3b83ed9e25473c2fc40863323c7c582.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c3b83ed9e25473c2fc40863323c7c582.jpg saved to cache
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04d7250>
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_98b7fd35771a5be82714a59138c8bb77.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_98b7fd35771a5be82714a59138c8bb77.jpg saved to cache
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_5d7b0110973bf51b75bf1b86fe493382.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5d7b0110973bf51b75bf1b86fe493382.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_f91c08cb9abed4f712b0a01c9abec00d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_f91c08cb9abed4f712b0a01c9abec00d.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_e346ebc0f9ed90452249dd301c7b2098.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_e346ebc0f9ed90452249dd301c7b2098.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_7ac1c90cb4fe2110a85daa1f846946ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_7ac1c90cb4fe2110a85daa1f846946ee.jpg not downloaded yet
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_062ae7084e508f8f7e51b971cec1d391.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dd8150cd38344e01ff0eac810c3394a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_a38d5611508bfd2e5c6a25d21d7509c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_a38d5611508bfd2e5c6a25d21d7509c8.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_dba27adb53ceae8232fdac2ca2abd814.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dba27adb53ceae8232fdac2ca2abd814.jpg not downloaded yet
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL18907> (referer: https://www.auto1.com/v1/car-details-view/XL18907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_b6d2ccf5ed69925de63585c335ab9a18.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_b6d2ccf5ed69925de63585c335ab9a18.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_8de3563d7a1a1bb7aea4b523ac523c5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_8de3563d7a1a1bb7aea4b523ac523c5c.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_5bf6b68272fd2f382ab9a2c208325fc4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5bf6b68272fd2f382ab9a2c208325fc4.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_1f98ffcb5ee99add5f8aef279cda09b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_1f98ffcb5ee99add5f8aef279cda09b9.jpg not downloaded yet
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_462ba32fcc580249a087c118267c8deb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_37ce0adc43d022e5a49e4399bc775a58.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37ce0adc43d022e5a49e4399bc775a58.jpg not downloaded yet
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_a50463059e9b7c39b4ed6b294b7b045e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_a50463059e9b7c39b4ed6b294b7b045e.jpg not downloaded yet
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_9a52844d034bad24f860cba6f28b1836.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_9a52844d034bad24f860cba6f28b1836.jpg not downloaded yet
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_c99bf5956a313a621326fc998657550f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c99bf5956a313a621326fc998657550f.jpg not downloaded yet
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad372ced0>
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_062ae7084e508f8f7e51b971cec1d391.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_062ae7084e508f8f7e51b971cec1d391.jpg saved to cache
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05cd450>
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_dd8150cd38344e01ff0eac810c3394a7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dd8150cd38344e01ff0eac810c3394a7.jpg saved to cache
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_993312d608979c0b3491b0d4c52714d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_37c8e05dd66d9192dba1e41044a6417f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37c8e05dd66d9192dba1e41044a6417f.jpg not downloaded yet
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_f186ed47e6eea579d192ac100dadfb0c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f186ed47e6eea579d192ac100dadfb0c.jpg not downloaded yet
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_ac300cb67aa2dafd7a2e532952c3438d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ac300cb67aa2dafd7a2e532952c3438d.jpg not downloaded yet
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_41476eeb4d20c777e027cf5a0c54f885.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_41476eeb4d20c777e027cf5a0c54f885.jpg not downloaded yet
2025-12-05 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5effb8d9-774d-5763-ba60-a576cb4173fe with identifier: XL18907
2025-12-05 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5effb8d9-774d-5763-ba60-a576cb4173fe with scrape type 2
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5effb8d9-774d-5763-ba60-a576cb4173fe with scrape type 2
2025-12-05 20:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5effb8d9-774d-5763-ba60-a576cb4173fe, identifier: XL18907
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_4478a92173c294056ad577d424896642.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_4478a92173c294056ad577d424896642.jpg not downloaded yet
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_fa81c9d29eaa963e31ad407091ebc5fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_fa81c9d29eaa963e31ad407091ebc5fb.jpg not downloaded yet
2025-12-05 20:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5effb8d9-774d-5763-ba60-a576cb4173fe with identifier: XL18907
2025-12-05 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5effb8d9-774d-5763-ba60-a576cb4173fe with identifier: XL18907
2025-12-05 20:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5effb8d9-774d-5763-ba60-a576cb4173fe with identifier: XL18907 to the API
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL18907>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:50:15Z',
 'fuel_type': 'petrol',
 'id': '5effb8d9-774d-5763-ba60-a576cb4173fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL18907',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'DR',
 'model': 'DR 3.0',
 'odometer': 1264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 3.0 1.5',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL18907%27 HTTP/1.1" 200 None
2025-12-05 20:03:10 [auto1.it] INFO: Saving data for XL18907: {'auction_closing_time': 1765039815.0, 'created_time': 1763582588.149751, 'last_price_update_time': 1764964990.316076}
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL18907') HTTP/1.1" 204 0
2025-12-05 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_6a25d3c3e9fb3ab542944bd4ac20b11f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ff274d57ee5ea18730978a862ba5ad41.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_8d1aba0f411e2ac6186a4ebb29fff783.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8d1aba0f411e2ac6186a4ebb29fff783.jpg not downloaded yet
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_6f866200ca89129291364167335e04ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_6f866200ca89129291364167335e04ed.jpg not downloaded yet
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae041ced0>
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_462ba32fcc580249a087c118267c8deb.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_462ba32fcc580249a087c118267c8deb.jpg saved to cache
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3717c10>
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_993312d608979c0b3491b0d4c52714d6.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_993312d608979c0b3491b0d4c52714d6.jpg saved to cache
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_3ff8b052e66a377adee2da3b28299d27.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_55bf404a4dd05fb59bc970636d2d6c94.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_55bf404a4dd05fb59bc970636d2d6c94.jpg not downloaded yet
2025-12-05 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_a393caac1cfa5f057f799d72d614c486.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_2c0d7c70424c54f6993baf05c9e4df6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_2c0d7c70424c54f6993baf05c9e4df6f.jpg not downloaded yet
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f6f10>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_6a25d3c3e9fb3ab542944bd4ac20b11f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_6a25d3c3e9fb3ab542944bd4ac20b11f.jpg saved to cache
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0473110>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_ff274d57ee5ea18730978a862ba5ad41.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ff274d57ee5ea18730978a862ba5ad41.jpg saved to cache
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_c55219136edd59d1832a3c0f378f267f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_c55219136edd59d1832a3c0f378f267f.jpg not downloaded yet
2025-12-05 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_ab16e960463fd12cc4e3565d36876690.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_6aaf9152010f06520fbd2b246a65daf2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_cc659dafcf35b4c4395e5239cde81b12.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_26271666391c88c65e6be912d5474954.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_f2bed30741a42532e107581aaa5582f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f2bed30741a42532e107581aaa5582f5.jpg not downloaded yet
2025-12-05 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_fee4dae5d21a6d75e35579fbc43fb808.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_f91c08cb9abed4f712b0a01c9abec00d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_b06fb8f1aba17a83a0b55d10e1cd9702.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_b06fb8f1aba17a83a0b55d10e1cd9702.jpg not downloaded yet
2025-12-05 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01faa10>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_3ff8b052e66a377adee2da3b28299d27.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_3ff8b052e66a377adee2da3b28299d27.jpg saved to cache
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0223e90>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_a393caac1cfa5f057f799d72d614c486.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_a393caac1cfa5f057f799d72d614c486.jpg saved to cache
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_1f98ffcb5ee99add5f8aef279cda09b9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dba27adb53ceae8232fdac2ca2abd814.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c99bf5956a313a621326fc998657550f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5d7b0110973bf51b75bf1b86fe493382.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_d1742ad668ccf61af144e74494ba4f85.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d5510>
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_ab16e960463fd12cc4e3565d36876690.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_ab16e960463fd12cc4e3565d36876690.jpg saved to cache
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0435ad0>
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_6aaf9152010f06520fbd2b246a65daf2.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_6aaf9152010f06520fbd2b246a65daf2.jpg saved to cache
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01a3c10>
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_cc659dafcf35b4c4395e5239cde81b12.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_cc659dafcf35b4c4395e5239cde81b12.jpg saved to cache
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0065dd0>
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_26271666391c88c65e6be912d5474954.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_26271666391c88c65e6be912d5474954.jpg saved to cache
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03cb9d0>
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_fee4dae5d21a6d75e35579fbc43fb808.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_fee4dae5d21a6d75e35579fbc43fb808.jpg saved to cache
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0129b90>
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_f91c08cb9abed4f712b0a01c9abec00d.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_f91c08cb9abed4f712b0a01c9abec00d.jpg saved to cache
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_1fb92324b5657432378230dca94e3134.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_6f866200ca89129291364167335e04ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_fa81c9d29eaa963e31ad407091ebc5fb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e6590>
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_1f98ffcb5ee99add5f8aef279cda09b9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_1f98ffcb5ee99add5f8aef279cda09b9.jpg saved to cache
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00667d0>
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_dba27adb53ceae8232fdac2ca2abd814.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dba27adb53ceae8232fdac2ca2abd814.jpg saved to cache
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e7f90>
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_c99bf5956a313a621326fc998657550f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c99bf5956a313a621326fc998657550f.jpg saved to cache
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a6590>
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_5d7b0110973bf51b75bf1b86fe493382.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5d7b0110973bf51b75bf1b86fe493382.jpg saved to cache
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056bd10>
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_d1742ad668ccf61af144e74494ba4f85.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_d1742ad668ccf61af144e74494ba4f85.jpg saved to cache
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02bcf90>
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_1fb92324b5657432378230dca94e3134.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_1fb92324b5657432378230dca94e3134.jpg saved to cache
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0222350>
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_6f866200ca89129291364167335e04ed.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_6f866200ca89129291364167335e04ed.jpg saved to cache
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0512510>
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_fa81c9d29eaa963e31ad407091ebc5fb.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_fa81c9d29eaa963e31ad407091ebc5fb.jpg saved to cache
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_4478a92173c294056ad577d424896642.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_55bf404a4dd05fb59bc970636d2d6c94.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_2c0d7c70424c54f6993baf05c9e4df6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8d1aba0f411e2ac6186a4ebb29fff783.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_41476eeb4d20c777e027cf5a0c54f885.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ac300cb67aa2dafd7a2e532952c3438d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_b06fb8f1aba17a83a0b55d10e1cd9702.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_9a52844d034bad24f860cba6f28b1836.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f186ed47e6eea579d192ac100dadfb0c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014e410>
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_4478a92173c294056ad577d424896642.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_4478a92173c294056ad577d424896642.jpg saved to cache
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37c8e05dd66d9192dba1e41044a6417f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_8de3563d7a1a1bb7aea4b523ac523c5c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_c55219136edd59d1832a3c0f378f267f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_a50463059e9b7c39b4ed6b294b7b045e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f2bed30741a42532e107581aaa5582f5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5bf6b68272fd2f382ab9a2c208325fc4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f3ed0>
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_55bf404a4dd05fb59bc970636d2d6c94.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_55bf404a4dd05fb59bc970636d2d6c94.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a73d0>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_2c0d7c70424c54f6993baf05c9e4df6f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_2c0d7c70424c54f6993baf05c9e4df6f.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f3550>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_8d1aba0f411e2ac6186a4ebb29fff783.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8d1aba0f411e2ac6186a4ebb29fff783.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03714d0>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_41476eeb4d20c777e027cf5a0c54f885.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_41476eeb4d20c777e027cf5a0c54f885.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0371350>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_ac300cb67aa2dafd7a2e532952c3438d.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ac300cb67aa2dafd7a2e532952c3438d.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae040f5d0>
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_b06fb8f1aba17a83a0b55d10e1cd9702.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_b06fb8f1aba17a83a0b55d10e1cd9702.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0370190>
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_9a52844d034bad24f860cba6f28b1836.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_9a52844d034bad24f860cba6f28b1836.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370ce90>
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_f186ed47e6eea579d192ac100dadfb0c.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f186ed47e6eea579d192ac100dadfb0c.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b3a5fc580d29db6d1566d50e9bf3b9a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_a38d5611508bfd2e5c6a25d21d7509c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_7ac1c90cb4fe2110a85daa1f846946ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_4c1d605be35214b278e276435e992c96.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_e346ebc0f9ed90452249dd301c7b2098.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_2963e5007b72a5b1d94e56f57be6047c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae031bc50>
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_37c8e05dd66d9192dba1e41044a6417f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37c8e05dd66d9192dba1e41044a6417f.jpg saved to cache
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad371d510>
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_8de3563d7a1a1bb7aea4b523ac523c5c.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_8de3563d7a1a1bb7aea4b523ac523c5c.jpg saved to cache
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0187910>
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_c55219136edd59d1832a3c0f378f267f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_c55219136edd59d1832a3c0f378f267f.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a8250>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_a50463059e9b7c39b4ed6b294b7b045e.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_a50463059e9b7c39b4ed6b294b7b045e.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04b9a90>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_f2bed30741a42532e107581aaa5582f5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f2bed30741a42532e107581aaa5582f5.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad371cf90>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_5bf6b68272fd2f382ab9a2c208325fc4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5bf6b68272fd2f382ab9a2c208325fc4.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4bb67c62bb9eef009a8a8d7fb53f3229.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e7676363f23cb9f3c5c74f3db737242b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b233e31da3b6a3578a5303582df0c17.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_57bd1ab0e3f1cfa5dc6953a792d531f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00e0f10>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_4b3a5fc580d29db6d1566d50e9bf3b9a.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b3a5fc580d29db6d1566d50e9bf3b9a.jpg saved to cache
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b6710>
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_a38d5611508bfd2e5c6a25d21d7509c8.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_a38d5611508bfd2e5c6a25d21d7509c8.jpg saved to cache
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007edd0>
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_7ac1c90cb4fe2110a85daa1f846946ee.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_7ac1c90cb4fe2110a85daa1f846946ee.jpg saved to cache
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0199b50>
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_4c1d605be35214b278e276435e992c96.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_4c1d605be35214b278e276435e992c96.jpg saved to cache
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05ccb90>
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_e346ebc0f9ed90452249dd301c7b2098.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_e346ebc0f9ed90452249dd301c7b2098.jpg saved to cache
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a6d10>
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_2963e5007b72a5b1d94e56f57be6047c.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_2963e5007b72a5b1d94e56f57be6047c.jpg saved to cache
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:23 [scrapy.extensions.logstats] INFO: Crawled 242 pages (at 71 pages/min), scraped 76 items (at 21 items/min)
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0311e50>
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_4bb67c62bb9eef009a8a8d7fb53f3229.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4bb67c62bb9eef009a8a8d7fb53f3229.jpg saved to cache
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0452f10>
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_e7676363f23cb9f3c5c74f3db737242b.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e7676363f23cb9f3c5c74f3db737242b.jpg saved to cache
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e2e50>
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_4b233e31da3b6a3578a5303582df0c17.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b233e31da3b6a3578a5303582df0c17.jpg saved to cache
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a8e10>
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_57bd1ab0e3f1cfa5dc6953a792d531f8.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_57bd1ab0e3f1cfa5dc6953a792d531f8.jpg saved to cache
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_7d6c2d08ce62155b87e7e689104245b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_0887a7049e68dd7a90af166a85be2d30.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_e84e34a1855f422344cac564deb643c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37ce0adc43d022e5a49e4399bc775a58.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_b6d2ccf5ed69925de63585c335ab9a18.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_bb2fc12fb65e8fd7275a853db5d999d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_d07925c3599093fc79ccfc7fcc8ebe0d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bd13e3f191733b9f370524e71c9ef3a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_faea69edf8a8a0a4693dd776a6382bee.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_689f18c5642787f9654bfb4bf389d0be.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_357efcdfe24427915327f7ddf6222334.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0376850>
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_7d6c2d08ce62155b87e7e689104245b5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_7d6c2d08ce62155b87e7e689104245b5.jpg saved to cache
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bb9fd1ded033e22b3addf20e7ef6709.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05d8490>
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_0887a7049e68dd7a90af166a85be2d30.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_0887a7049e68dd7a90af166a85be2d30.jpg saved to cache
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae008aa50>
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7c%252F467c7056d3a40f97c01f0e571633d951%252Fpa%252FDK98647_e84e34a1855f422344cac564deb643c6.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_e84e34a1855f422344cac564deb643c6.jpg saved to cache
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91
2025-12-05 20:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91, skipping ID generation
2025-12-05 20:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 with scrape type 1
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 from tracking dictionaries
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 sending to next pipeline
2025-12-05 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91, identifier: DK98647
2025-12-05 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e59fc9a8d5952317994b68b4458ae80e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_4be42652622b7d3454123c9be251c684.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_7357861b0c58227ec75dfc1c09ea0805.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 with identifier: DK98647
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 with identifier: DK98647
2025-12-05 20:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6da4cb2c-6649-5f23-ae21-f0c6c4e91a91 with identifier: DK98647 to the API
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_e84e34a1855f422344cac564deb643c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2025-12-06T16:28:33Z',
 'fuel_type': 'petrol',
 'id': '6da4cb2c-6649-5f23-ae21-f0c6c4e91a91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK98647',
 'listing': 'auction',
 'location': 'IT, Casagiove',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 32575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_e84e34a1855f422344cac564deb643c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4bb67c62bb9eef009a8a8d7fb53f3229.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b233e31da3b6a3578a5303582df0c17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_4b3a5fc580d29db6d1566d50e9bf3b9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_7ac1c90cb4fe2110a85daa1f846946ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_8de3563d7a1a1bb7aea4b523ac523c5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_a50463059e9b7c39b4ed6b294b7b045e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f186ed47e6eea579d192ac100dadfb0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_fa81c9d29eaa963e31ad407091ebc5fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_6f866200ca89129291364167335e04ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_55bf404a4dd05fb59bc970636d2d6c94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_2c0d7c70424c54f6993baf05c9e4df6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_c55219136edd59d1832a3c0f378f267f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_f2bed30741a42532e107581aaa5582f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da4cb2c-6649-5f23-ae21-f0c6c4e91a91/6da4cb2c-6649-5f23-ae21-f0c6c4e91a91_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7c/467c7056d3a40f97c01f0e571633d951/pa/DK98647_b06fb8f1aba17a83a0b55d10e1cd9702.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK98647%27 HTTP/1.1" 200 None
2025-12-05 20:03:26 [auto1.it] INFO: Saving data for DK98647: {'created_time': 1764965006.801085, 'last_price_update_time': 1764965006.801094, 'auction_closing_time': 1765038513.0}
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK98647') HTTP/1.1" 204 0
2025-12-05 20:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056dd90>
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_37ce0adc43d022e5a49e4399bc775a58.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37ce0adc43d022e5a49e4399bc775a58.jpg saved to cache
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f30d0>
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_b6d2ccf5ed69925de63585c335ab9a18.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_b6d2ccf5ed69925de63585c335ab9a18.jpg saved to cache
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056e890>
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_bb2fc12fb65e8fd7275a853db5d999d1.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_bb2fc12fb65e8fd7275a853db5d999d1.jpg saved to cache
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0302d10>
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_d07925c3599093fc79ccfc7fcc8ebe0d.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_d07925c3599093fc79ccfc7fcc8ebe0d.jpg saved to cache
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae012d210>
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_8bd13e3f191733b9f370524e71c9ef3a.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bd13e3f191733b9f370524e71c9ef3a.jpg saved to cache
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370c790>
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_faea69edf8a8a0a4693dd776a6382bee.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_faea69edf8a8a0a4693dd776a6382bee.jpg saved to cache
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0464350>
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_689f18c5642787f9654bfb4bf389d0be.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_689f18c5642787f9654bfb4bf389d0be.jpg saved to cache
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae040c4d0>
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_357efcdfe24427915327f7ddf6222334.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_357efcdfe24427915327f7ddf6222334.jpg saved to cache
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0345e10>
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_8bb9fd1ded033e22b3addf20e7ef6709.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bb9fd1ded033e22b3addf20e7ef6709.jpg saved to cache
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03cb290>
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_e59fc9a8d5952317994b68b4458ae80e.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e59fc9a8d5952317994b68b4458ae80e.jpg saved to cache
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02efd90>
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_4be42652622b7d3454123c9be251c684.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_4be42652622b7d3454123c9be251c684.jpg saved to cache
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04371d0>
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fd9%252Fccd9c54aeeda4a0ae18c1ed15164471d%252Fpa%252FTS66392_7357861b0c58227ec75dfc1c09ea0805.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_7357861b0c58227ec75dfc1c09ea0805.jpg saved to cache
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61
2025-12-05 20:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd1fccfa-b0e8-5a5e-a37d-b6867468dc61, skipping ID generation
2025-12-05 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 with scrape type 1
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 from tracking dictionaries
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 sending to next pipeline
2025-12-05 20:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd1fccfa-b0e8-5a5e-a37d-b6867468dc61, identifier: TS66392
2025-12-05 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ17283> (referer: https://www.auto1.com/v1/car-details-view/TZ17283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 with identifier: TS66392
2025-12-05 20:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 with identifier: TS66392
2025-12-05 20:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd1fccfa-b0e8-5a5e-a37d-b6867468dc61 with identifier: TS66392 to the API
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_7357861b0c58227ec75dfc1c09ea0805.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:13:27Z',
 'fuel_type': 'diesel',
 'id': 'bd1fccfa-b0e8-5a5e-a37d-b6867468dc61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS66392',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 149364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e59fc9a8d5952317994b68b4458ae80e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_062ae7084e508f8f7e51b971cec1d391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_4be42652622b7d3454123c9be251c684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ff274d57ee5ea18730978a862ba5ad41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_357efcdfe24427915327f7ddf6222334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_faea69edf8a8a0a4693dd776a6382bee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_7357861b0c58227ec75dfc1c09ea0805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_cc659dafcf35b4c4395e5239cde81b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_57bd1ab0e3f1cfa5dc6953a792d531f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_e7676363f23cb9f3c5c74f3db737242b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5d7b0110973bf51b75bf1b86fe493382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_a38d5611508bfd2e5c6a25d21d7509c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_5bf6b68272fd2f382ab9a2c208325fc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_9a52844d034bad24f860cba6f28b1836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1fccfa-b0e8-5a5e-a37d-b6867468dc61/bd1fccfa-b0e8-5a5e-a37d-b6867468dc61_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/d9/ccd9c54aeeda4a0ae18c1ed15164471d/pa/TS66392_ac300cb67aa2dafd7a2e532952c3438d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS66392%27 HTTP/1.1" 200 None
2025-12-05 20:03:32 [auto1.it] INFO: Saving data for TS66392: {'created_time': 1764965012.031864, 'last_price_update_time': 1764965012.031876, 'auction_closing_time': 1765037607.0}
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TS66392') HTTP/1.1" 204 0
2025-12-05 20:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ21279> (referer: https://www.auto1.com/v1/car-details-view/RZ21279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7a0cac-2b7e-5268-a9e1-b75438d5223a with identifier: TZ17283
2025-12-05 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7a0cac-2b7e-5268-a9e1-b75438d5223a with scrape type 2
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7a0cac-2b7e-5268-a9e1-b75438d5223a with scrape type 2
2025-12-05 20:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f7a0cac-2b7e-5268-a9e1-b75438d5223a, identifier: TZ17283
2025-12-05 20:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f7a0cac-2b7e-5268-a9e1-b75438d5223a with identifier: TZ17283
2025-12-05 20:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f7a0cac-2b7e-5268-a9e1-b75438d5223a with identifier: TZ17283
2025-12-05 20:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2025-12-05 20:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4f7a0cac-2b7e-5268-a9e1-b75438d5223a spider: auto1.it
2025-12-05 20:03:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4f7a0cac-2b7e-5268-a9e1-b75438d5223a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:05:10Z',
 'fuel_type': 'diesel',
 'id': '4f7a0cac-2b7e-5268-a9e1-b75438d5223a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ17283',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 77303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2023}
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ17283%27 HTTP/1.1" 200 None
2025-12-05 20:03:32 [auto1.it] INFO: Saving data for TZ17283: {'auction_closing_time': 1765037110.0, 'created_time': 1764705899.663639, 'last_price_update_time': 1764965012.450667}
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ17283') HTTP/1.1" 204 0
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_59b3e341de69dbb4d4d60a5c70861a03.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_3e5dabc5fa6eb4a8b406e2bea8ea6ca7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed9376d4-e3fe-5778-831d-06cec1077f02 with identifier: RZ21279
2025-12-05 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9376d4-e3fe-5778-831d-06cec1077f02 with scrape type 1
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_f7c8db1a60d64e66d7681a2dccb4e28a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_f7c8db1a60d64e66d7681a2dccb4e28a.jpg not downloaded yet
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_84ae3cbffbba21da103b89b0783cdf77.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_7aead62d8147b6dc7e2ca363205f4c74.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_7aead62d8147b6dc7e2ca363205f4c74.jpg not downloaded yet
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_b9b882081c17bdc6f848848662a155e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_b9b882081c17bdc6f848848662a155e9.jpg not downloaded yet
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_18e6b77ceff7c6b19b9105eaed04154f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_18e6b77ceff7c6b19b9105eaed04154f.jpg not downloaded yet
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05f56d0>
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_59b3e341de69dbb4d4d60a5c70861a03.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_59b3e341de69dbb4d4d60a5c70861a03.jpg saved to cache
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01a0d90>
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_3e5dabc5fa6eb4a8b406e2bea8ea6ca7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_3e5dabc5fa6eb4a8b406e2bea8ea6ca7.jpg saved to cache
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_d16c2c9a00d204ba42c6ee7f007289e8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_3c81a9aafda65e5b4707cdbe4be97e17.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_3c81a9aafda65e5b4707cdbe4be97e17.jpg not downloaded yet
2025-12-05 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_0a0f3e5650fa550ab6b3c1b4382c73d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_53ca22800908b0d83bdefcc9d320171b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_d2a7c78f83944858adf1a1a5bf28a8a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d2a7c78f83944858adf1a1a5bf28a8a4.jpg not downloaded yet
2025-12-05 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_14aff9fb00f9f6e4e142d5f084d42c45.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_ea58e97c0b2ecf871e9e88daeada713c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_ea58e97c0b2ecf871e9e88daeada713c.jpg not downloaded yet
2025-12-05 20:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05b7110>
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fee%252F39ee9b1214d4c12165cefa7913c94900%252Fpa%252FUE72623_84ae3cbffbba21da103b89b0783cdf77.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_84ae3cbffbba21da103b89b0783cdf77.jpg saved to cache
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167
2025-12-05 20:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54c7aa68-5512-5453-aaa3-0ec2aefaa167, skipping ID generation
2025-12-05 20:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167 with scrape type 1
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 54c7aa68-5512-5453-aaa3-0ec2aefaa167 from tracking dictionaries
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54c7aa68-5512-5453-aaa3-0ec2aefaa167 sending to next pipeline
2025-12-05 20:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54c7aa68-5512-5453-aaa3-0ec2aefaa167, identifier: UE72623
2025-12-05 20:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54c7aa68-5512-5453-aaa3-0ec2aefaa167 with identifier: UE72623
2025-12-05 20:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54c7aa68-5512-5453-aaa3-0ec2aefaa167 with identifier: UE72623
2025-12-05 20:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54c7aa68-5512-5453-aaa3-0ec2aefaa167 with identifier: UE72623 to the API
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_84ae3cbffbba21da103b89b0783cdf77.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 185,
 'expiration_date': '2025-12-06T16:26:15Z',
 'fuel_type': 'petrol',
 'id': '54c7aa68-5512-5453-aaa3-0ec2aefaa167',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE72623',
 'listing': 'auction',
 'location': 'IT, Cagliari',
 'make': 'DR',
 'model': 'DR 6.0',
 'odometer': 11957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_78836ffac278b4674f9e3baee8566b77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318288,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_8832892d05d69ee53c792a5d41c75704.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327858,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_63f821812d0821871d185f4c86155e8e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269217,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_84ae3cbffbba21da103b89b0783cdf77.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_59b3e341de69dbb4d4d60a5c70861a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301423,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_02f9b616495860ab47e20a6004f744ea.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266168,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_dcd800beed8c2d6b5f6511f4020dd3f6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_2f0154d2e61c2c018a61804777424bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333640,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_c06919da44a33bbd7edb2c4858f2e608.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_d3148204373ad8598aceb98652caecdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318272,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_4284a5758a885e58d29cb1df1e362b4c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286307,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_95413a5eaca86bc1b0dcba48c221e749.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_6b0cb754e6209e6fcda6536c4bb9691a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_17152cb3e0003d387a3e58352a06e210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c7aa68-5512-5453-aaa3-0ec2aefaa167/54c7aa68-5512-5453-aaa3-0ec2aefaa167_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ee/39ee9b1214d4c12165cefa7913c94900/pa/UE72623_12419c6f79b212a75d58ff148b1b1535.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 6.0 1.6 T-GDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE72623%27 HTTP/1.1" 200 None
2025-12-05 20:03:34 [auto1.it] INFO: Saving data for UE72623: {'created_time': 1764965014.084436, 'last_price_update_time': 1764965014.084448, 'auction_closing_time': 1765038375.0}
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UE72623') HTTP/1.1" 204 0
2025-12-05 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1b98dbf947db8bcb27f28f30283a318f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_e2c449e2f33c86ef812be3c4f9a7e843.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_8a881d534e52d05fe9557de7f042b897.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8a881d534e52d05fe9557de7f042b897.jpg not downloaded yet
2025-12-05 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_c261fc909a148065770e4e4eb4339b71.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_d5c0bab727916ed5d2e8d0b6ad6e7738.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d5c0bab727916ed5d2e8d0b6ad6e7738.jpg not downloaded yet
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01576d0>
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_d16c2c9a00d204ba42c6ee7f007289e8.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_d16c2c9a00d204ba42c6ee7f007289e8.jpg saved to cache
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007ecd0>
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fb3%252F12b3fddd51a6f90cb725998d4f3a6e91%252Fpa%252FTW13967_0a0f3e5650fa550ab6b3c1b4382c73d7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_0a0f3e5650fa550ab6b3c1b4382c73d7.jpg saved to cache
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6cb7a53-d2bd-5508-9561-820900130a4b
2025-12-05 20:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6cb7a53-d2bd-5508-9561-820900130a4b, skipping ID generation
2025-12-05 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6cb7a53-d2bd-5508-9561-820900130a4b with scrape type 1
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c6cb7a53-d2bd-5508-9561-820900130a4b from tracking dictionaries
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6cb7a53-d2bd-5508-9561-820900130a4b sending to next pipeline
2025-12-05 20:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6cb7a53-d2bd-5508-9561-820900130a4b, identifier: TW13967
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03efb90>
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_53ca22800908b0d83bdefcc9d320171b.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_53ca22800908b0d83bdefcc9d320171b.jpg saved to cache
2025-12-05 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0565bd0>
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_14aff9fb00f9f6e4e142d5f084d42c45.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_14aff9fb00f9f6e4e142d5f084d42c45.jpg saved to cache
2025-12-05 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6cb7a53-d2bd-5508-9561-820900130a4b with identifier: TW13967
2025-12-05 20:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6cb7a53-d2bd-5508-9561-820900130a4b with identifier: TW13967
2025-12-05 20:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6cb7a53-d2bd-5508-9561-820900130a4b with identifier: TW13967 to the API
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_0a0f3e5650fa550ab6b3c1b4382c73d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:52:25Z',
 'fuel_type': 'diesel',
 'id': 'c6cb7a53-d2bd-5508-9561-820900130a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW13967',
 'listing': 'auction',
 'location': 'IT, Pordenone',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 148336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_adbc740a597cc45cac61aa19addddcdb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3246807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e824f03084b4fe31c2a64382fc1904e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_cbdc6ff3a5042a4008e0775c46e1f2d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3090325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_5600f83afbf25872a03ea838343f1448.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_17fcc681546c9d6bc7de850152f41b89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_0a0f3e5650fa550ab6b3c1b4382c73d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_38622880a87794eaaedfcbb3c4a615af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7eef41de2841b6fccb570357719ebcdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_e9f1a0da248d90c693cc8673f640f07a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397332,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_251a2d3dba150a9d083b4c2f7e288367.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_401965799cf4f5ef5a97099b7f3035b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2821283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_2efb206941a98a19f560f211a04bcdfa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_3e5dabc5fa6eb4a8b406e2bea8ea6ca7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_a64ebada72dd5e651b88e67afcb183aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cb7a53-d2bd-5508-9561-820900130a4b/c6cb7a53-d2bd-5508-9561-820900130a4b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/b3/12b3fddd51a6f90cb725998d4f3a6e91/pa/TW13967_7da8f6ac15881b64908787c2b02f2115.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW13967%27 HTTP/1.1" 200 None
2025-12-05 20:03:35 [auto1.it] INFO: Saving data for TW13967: {'created_time': 1764965015.863472, 'last_price_update_time': 1764965015.863741, 'auction_closing_time': 1765039945.0}
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW13967') HTTP/1.1" 204 0
2025-12-05 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_f7c8db1a60d64e66d7681a2dccb4e28a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_879f52bc38f2db5963be6ece361714df.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_8eb39852061cf9e856ecb2587780b537.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8eb39852061cf9e856ecb2587780b537.jpg not downloaded yet
2025-12-05 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT90813> (referer: https://www.auto1.com/v1/car-details-view/HT90813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae020ad90>
2025-12-05 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_1b98dbf947db8bcb27f28f30283a318f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1b98dbf947db8bcb27f28f30283a318f.jpg saved to cache
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0436d50>
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_e2c449e2f33c86ef812be3c4f9a7e843.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_e2c449e2f33c86ef812be3c4f9a7e843.jpg saved to cache
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00f47d0>
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_c261fc909a148065770e4e4eb4339b71.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_c261fc909a148065770e4e4eb4339b71.jpg saved to cache
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:03:36 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_35a5319f41f201681469d6679779a82d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_35a5319f41f201681469d6679779a82d.jpg not downloaded yet
2025-12-05 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c69aebee53b48ea89186f677c8405281.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:36 [auto1.it] INFO: Found listing with ID: TX41333
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX41333%27 HTTP/1.1" 200 None
2025-12-05 20:03:36 [auto1.it] INFO: Scrape type for TX41333: 0
2025-12-05 20:03:36 [auto1.it] INFO: Found listing with ID: HX12723
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX12723%27 HTTP/1.1" 200 None
2025-12-05 20:03:36 [auto1.it] INFO: Scrape type for HX12723: 2
2025-12-05 20:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c020fe4d6963e5d35bd79871d4414c36.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_c53893a8b3b365c4bf5a64ec954a2c98.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_c53893a8b3b365c4bf5a64ec954a2c98.jpg not downloaded yet
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e4650>
2025-12-05 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_f7c8db1a60d64e66d7681a2dccb4e28a.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_f7c8db1a60d64e66d7681a2dccb4e28a.jpg saved to cache
2025-12-05 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0199350>
2025-12-05 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_879f52bc38f2db5963be6ece361714df.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_879f52bc38f2db5963be6ece361714df.jpg saved to cache
2025-12-05 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e326b5-b9d9-5550-8b5d-1379cbeafabe with identifier: HT90813
2025-12-05 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e326b5-b9d9-5550-8b5d-1379cbeafabe with scrape type 2
2025-12-05 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31e326b5-b9d9-5550-8b5d-1379cbeafabe with scrape type 2
2025-12-05 20:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 31e326b5-b9d9-5550-8b5d-1379cbeafabe, identifier: HT90813
2025-12-05 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_594978582f35e0e6340aebdad114b772.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:37 [auto1.it] INFO: Found listing with ID: DZ09819
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ09819%27 HTTP/1.1" 200 None
2025-12-05 20:03:37 [auto1.it] INFO: Scrape type for DZ09819: 1
2025-12-05 20:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 31e326b5-b9d9-5550-8b5d-1379cbeafabe with identifier: HT90813
2025-12-05 20:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 31e326b5-b9d9-5550-8b5d-1379cbeafabe with identifier: HT90813
2025-12-05 20:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 31e326b5-b9d9-5550-8b5d-1379cbeafabe with identifier: HT90813 to the API
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT90813>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.5L',
 'engine_horse_power': 328,
 'expiration_date': '2025-12-06T16:59:25Z',
 'fuel_type': 'hybrid',
 'id': '31e326b5-b9d9-5550-8b5d-1379cbeafabe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT90813',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Mazda',
 'model': 'CX-60',
 'odometer': 28439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-60 2.5 e-Skyactiv Plug-in Hybrid Takumi AWD',
 'transmission': 'automatic',
 'trim': 'Takumi AWD',
 'year': 2022}
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT90813%27 HTTP/1.1" 200 None
2025-12-05 20:03:38 [auto1.it] INFO: Saving data for HT90813: {'auction_closing_time': 1765040365.0, 'created_time': 1763582479.240105, 'last_price_update_time': 1764965018.054115}
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HT90813') HTTP/1.1" 204 0
2025-12-05 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_b9b882081c17bdc6f848848662a155e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_7aead62d8147b6dc7e2ca363205f4c74.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_a4baf9936d2fd0e02020d49cc8af8479.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_a4baf9936d2fd0e02020d49cc8af8479.jpg not downloaded yet
2025-12-05 20:03:38 [auto1.it] INFO: Found listing with ID: FA30496
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA30496%27 HTTP/1.1" 200 None
2025-12-05 20:03:38 [auto1.it] INFO: Scrape type for FA30496: 1
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_507577488821e1cdb2356515bba1dad7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_507577488821e1cdb2356515bba1dad7.jpg not downloaded yet
2025-12-05 20:03:38 [auto1.it] INFO: Found listing with ID: YK17945
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK17945%27 HTTP/1.1" 200 None
2025-12-05 20:03:38 [auto1.it] INFO: Scrape type for YK17945: 1
2025-12-05 20:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f29d0>
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_c69aebee53b48ea89186f677c8405281.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c69aebee53b48ea89186f677c8405281.jpg saved to cache
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c5a90>
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fac%252F2aaca5d66af23167059f787f6b86ca49%252Fpa%252FMC45094_c020fe4d6963e5d35bd79871d4414c36.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c020fe4d6963e5d35bd79871d4414c36.jpg saved to cache
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6782350-6e05-5c36-9e31-63ae63ad2eae
2025-12-05 20:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6782350-6e05-5c36-9e31-63ae63ad2eae, skipping ID generation
2025-12-05 20:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6782350-6e05-5c36-9e31-63ae63ad2eae with scrape type 1
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c6782350-6e05-5c36-9e31-63ae63ad2eae from tracking dictionaries
2025-12-05 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6782350-6e05-5c36-9e31-63ae63ad2eae sending to next pipeline
2025-12-05 20:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6782350-6e05-5c36-9e31-63ae63ad2eae, identifier: MC45094
2025-12-05 20:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05cda90>
2025-12-05 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff8%252F1ff8810f88652e0eefce9c830385b2fc%252Fpa%252FSZ44816_594978582f35e0e6340aebdad114b772.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_594978582f35e0e6340aebdad114b772.jpg saved to cache
2025-12-05 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2e478d6-98e6-5133-95e5-eaccff52e990
2025-12-05 20:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e478d6-98e6-5133-95e5-eaccff52e990, skipping ID generation
2025-12-05 20:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e478d6-98e6-5133-95e5-eaccff52e990 with scrape type 1
2025-12-05 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e2e478d6-98e6-5133-95e5-eaccff52e990 from tracking dictionaries
2025-12-05 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e478d6-98e6-5133-95e5-eaccff52e990 sending to next pipeline
2025-12-05 20:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2e478d6-98e6-5133-95e5-eaccff52e990, identifier: SZ44816
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_8c70e79f468330b08f599aa38ee1dd1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8c70e79f468330b08f599aa38ee1dd1d.jpg not downloaded yet
2025-12-05 20:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6782350-6e05-5c36-9e31-63ae63ad2eae with identifier: MC45094
2025-12-05 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6782350-6e05-5c36-9e31-63ae63ad2eae with identifier: MC45094
2025-12-05 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186160 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186160
2025-12-05 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c6782350-6e05-5c36-9e31-63ae63ad2eae spider: auto1.it
2025-12-05 20:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c6782350-6e05-5c36-9e31-63ae63ad2eae due to rule: high_mileage_for_country.json, error: 186160 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186160
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 197,
 'expiration_date': '2025-12-06T16:15:52Z',
 'fuel_type': 'diesel',
 'id': 'c6782350-6e05-5c36-9e31-63ae63ad2eae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC45094',
 'listing': 'auction',
 'location': 'IT, Modena',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 186160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c3b83ed9e25473c2fc40863323c7c582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_6a25d3c3e9fb3ab542944bd4ac20b11f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2432564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_c020fe4d6963e5d35bd79871d4414c36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_ab16e960463fd12cc4e3565d36876690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bb9fd1ded033e22b3addf20e7ef6709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2271727,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8bd13e3f191733b9f370524e71c9ef3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_7d6c2d08ce62155b87e7e689104245b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2316987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_bb2fc12fb65e8fd7275a853db5d999d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_2963e5007b72a5b1d94e56f57be6047c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_e346ebc0f9ed90452249dd301c7b2098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2295972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_b6d2ccf5ed69925de63585c335ab9a18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2264626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37ce0adc43d022e5a49e4399bc775a58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_37c8e05dd66d9192dba1e41044a6417f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_4478a92173c294056ad577d424896642.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6782350-6e05-5c36-9e31-63ae63ad2eae/c6782350-6e05-5c36-9e31-63ae63ad2eae_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/ac/2aaca5d66af23167059f787f6b86ca49/pa/MC45094_8d1aba0f411e2ac6186a4ebb29fff783.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 B4 Mild-Hybrid Momentum Business',
 'transmission': 'automatic',
 'trim': 'Momentum Business',
 'year': 2021}
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC45094%27 HTTP/1.1" 200 None
2025-12-05 20:03:39 [auto1.it] INFO: Saving data for MC45094: {'created_time': 1764965019.789754, 'last_price_update_time': 1764965019.789766, 'auction_closing_time': 1765037752.0}
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MC45094') HTTP/1.1" 204 0
2025-12-05 20:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2e478d6-98e6-5133-95e5-eaccff52e990 with identifier: SZ44816
2025-12-05 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2e478d6-98e6-5133-95e5-eaccff52e990 with identifier: SZ44816
2025-12-05 20:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2e478d6-98e6-5133-95e5-eaccff52e990 with identifier: SZ44816 to the API
2025-12-05 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_594978582f35e0e6340aebdad114b772.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-06T16:53:20Z',
 'fuel_type': 'diesel',
 'id': 'e2e478d6-98e6-5133-95e5-eaccff52e990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ44816',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 110272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_462ba32fcc580249a087c118267c8deb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dd8150cd38344e01ff0eac810c3394a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_689f18c5642787f9654bfb4bf389d0be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_993312d608979c0b3491b0d4c52714d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c69aebee53b48ea89186f677c8405281.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2587022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_594978582f35e0e6340aebdad114b772.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_0887a7049e68dd7a90af166a85be2d30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_26271666391c88c65e6be912d5474954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_d07925c3599093fc79ccfc7fcc8ebe0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_4c1d605be35214b278e276435e992c96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_f91c08cb9abed4f712b0a01c9abec00d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_dba27adb53ceae8232fdac2ca2abd814.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_1f98ffcb5ee99add5f8aef279cda09b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_c99bf5956a313a621326fc998657550f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e478d6-98e6-5133-95e5-eaccff52e990/e2e478d6-98e6-5133-95e5-eaccff52e990_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f8/1ff8810f88652e0eefce9c830385b2fc/pa/SZ44816_41476eeb4d20c777e027cf5a0c54f885.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic HSE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE',
 'year': 2020}
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ44816%27 HTTP/1.1" 200 None
2025-12-05 20:03:40 [auto1.it] INFO: Saving data for SZ44816: {'created_time': 1764965020.215084, 'last_price_update_time': 1764965020.215098, 'auction_closing_time': 1765040000.0}
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ44816') HTTP/1.1" 204 0
2025-12-05 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_45e62820d01bd12da830c71479235162.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:40 [auto1.it] INFO: Found listing with ID: GZ43068
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ43068%27 HTTP/1.1" 200 None
2025-12-05 20:03:40 [auto1.it] INFO: Scrape type for GZ43068: 1
2025-12-05 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8a881d534e52d05fe9557de7f042b897.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03c9190>
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_b9b882081c17bdc6f848848662a155e9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_b9b882081c17bdc6f848848662a155e9.jpg saved to cache
2025-12-05 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3716d10>
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_7aead62d8147b6dc7e2ca363205f4c74.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_7aead62d8147b6dc7e2ca363205f4c74.jpg saved to cache
2025-12-05 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:40 [auto1.it] INFO: Found listing with ID: SC12614
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC12614%27 HTTP/1.1" 200 None
2025-12-05 20:03:40 [auto1.it] INFO: Scrape type for SC12614: 2
2025-12-05 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d5c0bab727916ed5d2e8d0b6ad6e7738.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_9adb9cb83d21927a6acdc433a90e6957.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:40 [auto1.it] INFO: Found listing with ID: RT10287
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10287%27 HTTP/1.1" 200 None
2025-12-05 20:03:40 [auto1.it] INFO: Scrape type for RT10287: 2
2025-12-05 20:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00651d0>
2025-12-05 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_45e62820d01bd12da830c71479235162.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_45e62820d01bd12da830c71479235162.jpg saved to cache
2025-12-05 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0489290>
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_8a881d534e52d05fe9557de7f042b897.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8a881d534e52d05fe9557de7f042b897.jpg saved to cache
2025-12-05 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_548703855aa511a511ee5d080a722196.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:41 [auto1.it] INFO: Found listing with ID: KY20134
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY20134%27 HTTP/1.1" 200 None
2025-12-05 20:03:41 [auto1.it] INFO: Scrape type for KY20134: 1
2025-12-05 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8eb39852061cf9e856ecb2587780b537.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_4ba7c8df41dc555e35b3553b5f02788d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:41 [auto1.it] INFO: Found listing with ID: VF92545
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2025-12-05 20:03:41 [auto1.it] INFO: Scrape type for VF92545: 1
2025-12-05 20:03:41 [auto1.it] INFO: Found listing with ID: KM95714
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM95714%27 HTTP/1.1" 200 None
2025-12-05 20:03:41 [auto1.it] INFO: Scrape type for KM95714: 1
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae008ec90>
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_d5c0bab727916ed5d2e8d0b6ad6e7738.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d5c0bab727916ed5d2e8d0b6ad6e7738.jpg saved to cache
2025-12-05 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04d7410>
2025-12-05 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fb7%252Fd6b78d84a383e67ebdf20d5fbd285e23%252Fpa%252FHG98789_9adb9cb83d21927a6acdc433a90e6957.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_9adb9cb83d21927a6acdc433a90e6957.jpg saved to cache
2025-12-05 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 870051fc-cabf-5061-8f18-4a80deb14b94
2025-12-05 20:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 870051fc-cabf-5061-8f18-4a80deb14b94, skipping ID generation
2025-12-05 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870051fc-cabf-5061-8f18-4a80deb14b94 with scrape type 1
2025-12-05 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 870051fc-cabf-5061-8f18-4a80deb14b94 from tracking dictionaries
2025-12-05 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 870051fc-cabf-5061-8f18-4a80deb14b94 sending to next pipeline
2025-12-05 20:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 870051fc-cabf-5061-8f18-4a80deb14b94, identifier: HG98789
2025-12-05 20:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 870051fc-cabf-5061-8f18-4a80deb14b94 with identifier: HG98789
2025-12-05 20:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 870051fc-cabf-5061-8f18-4a80deb14b94 with identifier: HG98789
2025-12-05 20:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 870051fc-cabf-5061-8f18-4a80deb14b94 with identifier: HG98789 to the API
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_9adb9cb83d21927a6acdc433a90e6957.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:16:52Z',
 'fuel_type': 'diesel',
 'id': '870051fc-cabf-5061-8f18-4a80deb14b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG98789',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 44548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_9adb9cb83d21927a6acdc433a90e6957.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_98b7fd35771a5be82714a59138c8bb77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_91d1928730980f1507f3b173bc8fb988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_efa8827e609f43458903107c54fa3035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_937d1c84cc9cea3bb976d526b7b62c8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_64ac8490cfe22350151ebd16a8ed261f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_d1742ad668ccf61af144e74494ba4f85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2965607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_1fb92324b5657432378230dca94e3134.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2929784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_3ff8b052e66a377adee2da3b28299d27.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_fee4dae5d21a6d75e35579fbc43fb808.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_5530757f705a43f37ffca27d17e975af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2892577,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_a393caac1cfa5f057f799d72d614c486.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_e2baad63f0abc89b018b48c1a296148b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_6aaf9152010f06520fbd2b246a65daf2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870051fc-cabf-5061-8f18-4a80deb14b94/870051fc-cabf-5061-8f18-4a80deb14b94_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/b7/d6b78d84a383e67ebdf20d5fbd285e23/pa/HG98789_875fb1d6cb1d10c981d358bafead1b38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D165 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2021}
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG98789%27 HTTP/1.1" 200 None
2025-12-05 20:03:42 [auto1.it] INFO: Saving data for HG98789: {'created_time': 1764965022.711869, 'last_price_update_time': 1764965022.711883, 'auction_closing_time': 1765037812.0}
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG98789') HTTP/1.1" 204 0
2025-12-05 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8c70e79f468330b08f599aa38ee1dd1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_a4baf9936d2fd0e02020d49cc8af8479.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:42 [auto1.it] INFO: Found listing with ID: WF21370
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF21370%27 HTTP/1.1" 200 None
2025-12-05 20:03:42 [auto1.it] INFO: Scrape type for WF21370: 2
2025-12-05 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:42 [auto1.it] INFO: Found listing with ID: LY28002
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY28002%27 HTTP/1.1" 200 None
2025-12-05 20:03:42 [auto1.it] INFO: Scrape type for LY28002: 2
2025-12-05 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05f29d0>
2025-12-05 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F0b%252F7b0b42960e97cad54c6a846402f36905%252Fpa%252FCZ27491_548703855aa511a511ee5d080a722196.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_548703855aa511a511ee5d080a722196.jpg saved to cache
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e
2025-12-05 20:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a3fb221-e8f6-5c19-8861-8f02e77e233e, skipping ID generation
2025-12-05 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e with scrape type 1
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8a3fb221-e8f6-5c19-8861-8f02e77e233e from tracking dictionaries
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a3fb221-e8f6-5c19-8861-8f02e77e233e sending to next pipeline
2025-12-05 20:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a3fb221-e8f6-5c19-8861-8f02e77e233e, identifier: CZ27491
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0584c90>
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_8eb39852061cf9e856ecb2587780b537.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8eb39852061cf9e856ecb2587780b537.jpg saved to cache
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0089e90>
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_4ba7c8df41dc555e35b3553b5f02788d.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_4ba7c8df41dc555e35b3553b5f02788d.jpg saved to cache
2025-12-05 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:03:43 [auto1.it] INFO: Found listing with ID: TL25124
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL25124%27 HTTP/1.1" 200 None
2025-12-05 20:03:43 [auto1.it] INFO: Scrape type for TL25124: 1
2025-12-05 20:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491
2025-12-05 20:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491
2025-12-05 20:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a3fb221-e8f6-5c19-8861-8f02e77e233e with identifier: CZ27491 to the API
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_548703855aa511a511ee5d080a722196.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:56:13Z',
 'fuel_type': 'petrol',
 'id': '8a3fb221-e8f6-5c19-8861-8f02e77e233e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ27491',
 'listing': 'auction',
 'location': 'IT, Rende',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 20524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507038,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a2f0b1f7ae0e23ab981bb43f790dc0cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a8aa715269e99d3847008fa5722176f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a89ea37b643db2d38ff959c9c9c47110.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_70713c0303bd1fc5570c89b371d9b15a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599662,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e13c7e4a9a1ea0c040e33da2a1934620.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_6c66901c509f61f7e34703a99fd80ebe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_548703855aa511a511ee5d080a722196.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a9d90811abb35d1aeff683a99b33be8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_92ee6c6fbb9c3563ec147cd836a86f0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_884c41be7ba4c8c46f75895133d939b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2765011,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_ca42cd001556cf48291f1cd77fbe360f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_5f3960664e0914e5830ba1fdcad9add5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_e4e5fd45618206d85a4629976b93054d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_c4b89b4eba1d460aeebd0750d123a5ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a3fb221-e8f6-5c19-8861-8f02e77e233e/8a3fb221-e8f6-5c19-8861-8f02e77e233e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/0b/7b0b42960e97cad54c6a846402f36905/pa/CZ27491_a6946145f89dc5f4ca3831d639d6b9ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ27491%27 HTTP/1.1" 200 None
2025-12-05 20:03:44 [auto1.it] INFO: Saving data for CZ27491: {'created_time': 1764965024.446962, 'last_price_update_time': 1764965024.446993, 'auction_closing_time': 1765040173.0}
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ27491') HTTP/1.1" 204 0
2025-12-05 20:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:44 [auto1.it] INFO: Found listing with ID: LN66552
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66552%27 HTTP/1.1" 200 None
2025-12-05 20:03:44 [auto1.it] INFO: Scrape type for LN66552: 1
2025-12-05 20:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC12614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ43068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ09819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK17945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA30496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae020d950>
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_8c70e79f468330b08f599aa38ee1dd1d.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8c70e79f468330b08f599aa38ee1dd1d.jpg saved to cache
2025-12-05 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e36d0>
2025-12-05 20:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_a4baf9936d2fd0e02020d49cc8af8479.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_a4baf9936d2fd0e02020d49cc8af8479.jpg saved to cache
2025-12-05 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:45 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: KK64864
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK64864%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for KK64864: 0
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: EM01211
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM01211%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for EM01211: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: FR37481
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR37481%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for FR37481: 1
2025-12-05 20:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: YP00862
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP00862%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for YP00862: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: WW34893
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW34893%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for WW34893: 2
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: GZ28194
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ28194%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for GZ28194: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: GU66425
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU66425%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for GU66425: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: KX66152
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX66152%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for KX66152: 2
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: YW11574
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW11574%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for YW11574: 2
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: YZ61558
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ61558%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for YZ61558: 2
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: GE44400
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE44400%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for GE44400: 2
2025-12-05 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_c53893a8b3b365c4bf5a64ec954a2c98.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: NR71771
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR71771%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for NR71771: 2
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: FS22846
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS22846%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for FS22846: 2
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: BY98220
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY98220%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for BY98220: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: KA16351
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA16351%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for KA16351: 2
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0451e50>
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_c53893a8b3b365c4bf5a64ec954a2c98.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_c53893a8b3b365c4bf5a64ec954a2c98.jpg saved to cache
2025-12-05 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_18e6b77ceff7c6b19b9105eaed04154f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: AW14476
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW14476%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for AW14476: 2
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: ZZ94683
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ94683%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for ZZ94683: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: HD68470
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD68470%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for HD68470: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: JB86723
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB86723%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for JB86723: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: KM04068
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM04068%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for KM04068: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: CZ40954
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ40954%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for CZ40954: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: GG58363
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG58363%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for GG58363: 1
2025-12-05 20:03:45 [auto1.it] INFO: Found listing with ID: UB92069
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB92069%27 HTTP/1.1" 200 None
2025-12-05 20:03:45 [auto1.it] INFO: Scrape type for UB92069: 1
2025-12-05 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d2a7c78f83944858adf1a1a5bf28a8a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae045c950>
2025-12-05 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_18e6b77ceff7c6b19b9105eaed04154f.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_18e6b77ceff7c6b19b9105eaed04154f.jpg saved to cache
2025-12-05 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_ea58e97c0b2ecf871e9e88daeada713c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: VW18274
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW18274%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for VW18274: 1
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: NY34692
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY34692%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for NY34692: 2
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: VY71575
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY71575%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for VY71575: 1
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: DB02360
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB02360%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for DB02360: 2
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF21370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF92545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM95714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN66552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_3c81a9aafda65e5b4707cdbe4be97e17.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: XK00729
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK00729%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for XK00729: 1
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: EA06661
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA06661%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for EA06661: 2
2025-12-05 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a3490>
2025-12-05 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_d2a7c78f83944858adf1a1a5bf28a8a4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d2a7c78f83944858adf1a1a5bf28a8a4.jpg saved to cache
2025-12-05 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: PV13069
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV13069%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for PV13069: 1
2025-12-05 20:03:46 [auto1.it] INFO: Found listing with ID: LX99964
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX99964%27 HTTP/1.1" 200 None
2025-12-05 20:03:46 [auto1.it] INFO: Scrape type for LX99964: 1
2025-12-05 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT10287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01a1150>
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_ea58e97c0b2ecf871e9e88daeada713c.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_ea58e97c0b2ecf871e9e88daeada713c.jpg saved to cache
2025-12-05 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:47 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a5090>
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_3c81a9aafda65e5b4707cdbe4be97e17.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_3c81a9aafda65e5b4707cdbe4be97e17.jpg saved to cache
2025-12-05 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: AF20385
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF20385%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for AF20385: 1
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: ZP66888
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66888%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for ZP66888: 2
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: SM97428
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM97428%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for SM97428: 2
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: NM32123
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM32123%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for NM32123: 1
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: DU65956
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU65956%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for DU65956: 2
2025-12-05 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY28002/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_507577488821e1cdb2356515bba1dad7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: RC08182
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC08182%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for RC08182: 1
2025-12-05 20:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: JB07830
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB07830%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for JB07830: 1
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: TZ58430
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ58430%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for TZ58430: 1
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: LB50732
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50732%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for LB50732: 1
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: MD14180
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for MD14180: 1
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: HP11759
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP11759%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for HP11759: 2
2025-12-05 20:03:47 [auto1.it] INFO: Found listing with ID: NX36861
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX36861%27 HTTP/1.1" 200 None
2025-12-05 20:03:47 [auto1.it] INFO: Scrape type for NX36861: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: KK31902
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK31902%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for KK31902: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: ZH40946
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH40946%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for ZH40946: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: MV75173
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV75173%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for MV75173: 1
2025-12-05 20:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3715c10>
2025-12-05 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_507577488821e1cdb2356515bba1dad7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_507577488821e1cdb2356515bba1dad7.jpg saved to cache
2025-12-05 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: MW43217
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW43217%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for MW43217: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: UT73066
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT73066%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for UT73066: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: XT46123
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT46123%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for XT46123: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: YW02241
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW02241%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for YW02241: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: GV64817
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV64817%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for GV64817: 2
2025-12-05 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY20134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: LU15302
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU15302%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for LU15302: 2
2025-12-05 20:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: JN60892
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN60892%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for JN60892: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: BP08854
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08854%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for BP08854: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: EE73426
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE73426%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for EE73426: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: KC21681
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC21681%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for KC21681: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: HC13600
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC13600%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for HC13600: 2
2025-12-05 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA16351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: BZ10581
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ10581%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for BZ10581: 2
2025-12-05 20:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE44400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX12723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: HF33794
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF33794%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for HF33794: 1
2025-12-05 20:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: FB36220
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB36220%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for FB36220: 1
2025-12-05 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL25124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: EM38721
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM38721%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for EM38721: 2
2025-12-05 20:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: HS63299
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS63299%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for HS63299: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: DK85340
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK85340%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for DK85340: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: TM70777
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM70777%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for TM70777: 0
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: AL85542
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL85542%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for AL85542: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: SD77820
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD77820%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for SD77820: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: BE58033
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE58033%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for BE58033: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: XF76869
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF76869%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for XF76869: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: UF60183
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF60183%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for UF60183: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: SK30894
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK30894%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for SK30894: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: FN81119
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81119%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for FN81119: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: FF57378
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF57378%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for FF57378: 2
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: SS94947
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2025-12-05 20:03:48 [auto1.it] INFO: Scrape type for SS94947: 1
2025-12-05 20:03:48 [auto1.it] INFO: Found listing with ID: WF17788
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF17788%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for WF17788: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: JP94676
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP94676%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for JP94676: 1
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: DJ04394
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ04394%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for DJ04394: 2
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP66888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: NT07834
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT07834%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for NT07834: 1
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: EP34580
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP34580%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for EP34580: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: TK25750
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK25750%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for TK25750: 1
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: HK45247
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK45247%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for HK45247: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: KG59553
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG59553%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for KG59553: 2
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF20385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: EV82376
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV82376%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for EV82376: 2
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: MP56033
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP56033%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for MP56033: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: FL04510
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL04510%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for FL04510: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: GA79418
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA79418%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for GA79418: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: PC65612
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC65612%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for PC65612: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: AV22588
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV22588%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for AV22588: 1
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: TD15541
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD15541%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for TD15541: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: JA93014
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA93014%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for JA93014: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: BL08062
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL08062%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for BL08062: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: BB48668
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB48668%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for BB48668: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: LA46631
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA46631%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for LA46631: 2
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN66552> (referer: https://www.auto1.com/v1/car-details-view/LN66552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: JB16740
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB16740%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for JB16740: 1
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: PJ96401
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ96401%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for PJ96401: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: HW99743
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99743%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for HW99743: 0
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: BG39549
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG39549%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for BG39549: 0
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: EL99717
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL99717%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for EL99717: 2
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: MJ70755
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ70755%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for MJ70755: 1
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX99964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9664c0-1e5e-5a04-aa81-c61e014f9286 with identifier: LN66552
2025-12-05 20:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286 with scrape type 1
2025-12-05 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_40c46d39038bfd5c0dbf690137476193.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_40c46d39038bfd5c0dbf690137476193.jpg not downloaded yet
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: TY92784
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY92784%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for TY92784: 1
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_af01a048616e2e517876dfc0d259a6fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_af01a048616e2e517876dfc0d259a6fa.jpg not downloaded yet
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: SA26868
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA26868%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for SA26868: 1
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_4a86fa14e8da386d0faf7fba2af4dcc2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_4a86fa14e8da386d0faf7fba2af4dcc2.jpg not downloaded yet
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF92545> (referer: https://www.auto1.com/v1/car-details-view/VF92545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: VP46319
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP46319%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for VP46319: 1
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_aa8363d1f95d715e0c874e7581dcef4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_aa8363d1f95d715e0c874e7581dcef4a.jpg not downloaded yet
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_40c46d39038bfd5c0dbf690137476193.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: GT71409
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT71409%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for GT71409: 2
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_69adb6b8ac20d16329c444f6e3d6a28c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_69adb6b8ac20d16329c444f6e3d6a28c.jpg not downloaded yet
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM95714> (referer: https://www.auto1.com/v1/car-details-view/KM95714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF21370> (referer: https://www.auto1.com/v1/car-details-view/WF21370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: UP67985
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP67985%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [auto1.it] INFO: Scrape type for UP67985: 2
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_87127f6cb55b70392287e9561c8a8f6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_87127f6cb55b70392287e9561c8a8f6d.jpg not downloaded yet
2025-12-05 20:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:49 [auto1.it] INFO: Found listing with ID: PW70541
2025-12-05 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70541%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [auto1.it] INFO: Scrape type for PW70541: 1
2025-12-05 20:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545
2025-12-05 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572dbbcd-81e9-524d-84f9-f02812f568db with scrape type 1
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_d82614331626db62b351bbb3623f5d5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_d82614331626db62b351bbb3623f5d5f.jpg not downloaded yet
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_6a549fc269f9f0e2dfddf478a17d3f45.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_6a549fc269f9f0e2dfddf478a17d3f45.jpg not downloaded yet
2025-12-05 20:03:50 [auto1.it] INFO: Found listing with ID: FK02504
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK02504%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [auto1.it] INFO: Scrape type for FK02504: 2
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_3669129a70a861172b911134268f3f36.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3669129a70a861172b911134268f3f36.jpg not downloaded yet
2025-12-05 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_aa8363d1f95d715e0c874e7581dcef4a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_13f8de7ca7096aa8af403199f9ba95ce.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_13f8de7ca7096aa8af403199f9ba95ce.jpg not downloaded yet
2025-12-05 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a4cd0>
2025-12-05 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_40c46d39038bfd5c0dbf690137476193.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_40c46d39038bfd5c0dbf690137476193.jpg saved to cache
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb66924-02f4-55e2-a507-ce5d0b134f10 with identifier: KM95714
2025-12-05 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb66924-02f4-55e2-a507-ce5d0b134f10 with scrape type 1
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item aeb66924-02f4-55e2-a507-ce5d0b134f10
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_566f86e8a505912c78bd41794805e254.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_566f86e8a505912c78bd41794805e254.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_6b0e8a0340887d1c5afb51c6a450f433.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_6b0e8a0340887d1c5afb51c6a450f433.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_14a5ce22e154b1a5bf7e7c8fcc549ed5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_14a5ce22e154b1a5bf7e7c8fcc549ed5.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_53689a7b72130c075f8f7719615fe221.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_53689a7b72130c075f8f7719615fe221.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_063c449f5680d0c2ddf2e96ca2d449d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_063c449f5680d0c2ddf2e96ca2d449d2.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_5813e5af8914b7dce1ee2ed5dfbab771.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_5813e5af8914b7dce1ee2ed5dfbab771.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_8cd0cba046971c0e674de8cbef64465c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_8cd0cba046971c0e674de8cbef64465c.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_c3b126f0f1f5d2b4931d9e47ebb00873.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_c3b126f0f1f5d2b4931d9e47ebb00873.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_aa77a6ec04905b49e7345f9dc57fa515.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_aa77a6ec04905b49e7345f9dc57fa515.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_3e5bc3b2e897cd7a37fb0cd384dd7c2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_3e5bc3b2e897cd7a37fb0cd384dd7c2f.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_66bd8cbf810630e67b0da1c66a5a1827.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_66bd8cbf810630e67b0da1c66a5a1827.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_b4dd86b4650ea828a91a44187548555d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_b4dd86b4650ea828a91a44187548555d.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_51a7c815e76c7971319496e97fba3632.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_51a7c815e76c7971319496e97fba3632.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_81fb5eefca362c87bdf2b5a40f28b8e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_81fb5eefca362c87bdf2b5a40f28b8e5.jpg already downloaded
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F87%252F5787eb015239dc9f44f5b83c02c3a1da%252Fpa%252FKM95714_4a7f549e78f9eed4072e789dbdded116.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_4a7f549e78f9eed4072e789dbdded116.jpg already downloaded
2025-12-05 20:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aeb66924-02f4-55e2-a507-ce5d0b134f10, identifier: KM95714
2025-12-05 20:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f49e8975-a4b1-5e34-b6be-c519470adc3a with identifier: WF21370
2025-12-05 20:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49e8975-a4b1-5e34-b6be-c519470adc3a with scrape type 2
2025-12-05 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f49e8975-a4b1-5e34-b6be-c519470adc3a with scrape type 2
2025-12-05 20:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f49e8975-a4b1-5e34-b6be-c519470adc3a, identifier: WF21370
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_9a5dfd954e0374e8036bfc377582a317.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a5dfd954e0374e8036bfc377582a317.jpg not downloaded yet
2025-12-05 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aeb66924-02f4-55e2-a507-ce5d0b134f10 with identifier: KM95714
2025-12-05 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aeb66924-02f4-55e2-a507-ce5d0b134f10 with identifier: KM95714
2025-12-05 20:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aeb66924-02f4-55e2-a507-ce5d0b134f10 with identifier: KM95714 to the API
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KM95714>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:09:17Z',
 'fuel_type': 'diesel',
 'id': 'aeb66924-02f4-55e2-a507-ce5d0b134f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM95714',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 148583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_566f86e8a505912c78bd41794805e254.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_6b0e8a0340887d1c5afb51c6a450f433.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_14a5ce22e154b1a5bf7e7c8fcc549ed5.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_53689a7b72130c075f8f7719615fe221.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_063c449f5680d0c2ddf2e96ca2d449d2.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_5813e5af8914b7dce1ee2ed5dfbab771.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_8cd0cba046971c0e674de8cbef64465c.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_c3b126f0f1f5d2b4931d9e47ebb00873.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_aa77a6ec04905b49e7345f9dc57fa515.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_3e5bc3b2e897cd7a37fb0cd384dd7c2f.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_66bd8cbf810630e67b0da1c66a5a1827.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_b4dd86b4650ea828a91a44187548555d.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_51a7c815e76c7971319496e97fba3632.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_81fb5eefca362c87bdf2b5a40f28b8e5.jpg',
                'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_4a7f549e78f9eed4072e789dbdded116.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3084853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_566f86e8a505912c78bd41794805e254.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_6b0e8a0340887d1c5afb51c6a450f433.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_14a5ce22e154b1a5bf7e7c8fcc549ed5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_53689a7b72130c075f8f7719615fe221.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3203790,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_063c449f5680d0c2ddf2e96ca2d449d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3319827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_5813e5af8914b7dce1ee2ed5dfbab771.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2994559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_8cd0cba046971c0e674de8cbef64465c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2975458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_c3b126f0f1f5d2b4931d9e47ebb00873.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3042171,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_aa77a6ec04905b49e7345f9dc57fa515.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_3e5bc3b2e897cd7a37fb0cd384dd7c2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_66bd8cbf810630e67b0da1c66a5a1827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_b4dd86b4650ea828a91a44187548555d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_51a7c815e76c7971319496e97fba3632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_81fb5eefca362c87bdf2b5a40f28b8e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb66924-02f4-55e2-a507-ce5d0b134f10/aeb66924-02f4-55e2-a507-ce5d0b134f10_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/87/5787eb015239dc9f44f5b83c02c3a1da/pa/KM95714_4a7f549e78f9eed4072e789dbdded116.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2017}
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM95714%27 HTTP/1.1" 200 None
2025-12-05 20:03:51 [auto1.it] INFO: Saving data for KM95714: {'created_time': 1764965031.850906, 'last_price_update_time': 1764965031.85092, 'auction_closing_time': 1765037357.0}
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM95714') HTTP/1.1" 204 0
2025-12-05 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f49e8975-a4b1-5e34-b6be-c519470adc3a with identifier: WF21370
2025-12-05 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f49e8975-a4b1-5e34-b6be-c519470adc3a with identifier: WF21370
2025-12-05 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2025-12-05 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f49e8975-a4b1-5e34-b6be-c519470adc3a spider: auto1.it
2025-12-05 20:03:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f49e8975-a4b1-5e34-b6be-c519470adc3a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:20:20Z',
 'fuel_type': 'diesel',
 'id': 'f49e8975-a4b1-5e34-b6be-c519470adc3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF21370',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 112640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2022}
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF21370%27 HTTP/1.1" 200 None
2025-12-05 20:03:52 [auto1.it] INFO: Saving data for WF21370: {'auction_closing_time': 1765038020.0, 'created_time': 1764014700.821794, 'last_price_update_time': 1764965032.249154}
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WF21370') HTTP/1.1" 204 0
2025-12-05 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_69adb6b8ac20d16329c444f6e3d6a28c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_e3f138880fafbf173fa625930e753f39.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_e3f138880fafbf173fa625930e753f39.jpg not downloaded yet
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_4d404ba2e0d36a3a89a426aaca2bc5ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4d404ba2e0d36a3a89a426aaca2bc5ed.jpg not downloaded yet
2025-12-05 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV13069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV64817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM97428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA06661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:52 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0342650>
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_aa8363d1f95d715e0c874e7581dcef4a.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_aa8363d1f95d715e0c874e7581dcef4a.jpg saved to cache
2025-12-05 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_c72e7fbdc33fad5623dc5c81e3991f99.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_c72e7fbdc33fad5623dc5c81e3991f99.jpg not downloaded yet
2025-12-05 20:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_6a549fc269f9f0e2dfddf478a17d3f45.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_476e6732b12fd43b1969ddceb007a158.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_476e6732b12fd43b1969ddceb007a158.jpg not downloaded yet
2025-12-05 20:03:52 [auto1.it] INFO: Found listing with ID: DP28978
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP28978%27 HTTP/1.1" 200 None
2025-12-05 20:03:52 [auto1.it] INFO: Scrape type for DP28978: 1
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_f354c18bc29e0d9abd188ea3f52d29e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_f354c18bc29e0d9abd188ea3f52d29e2.jpg not downloaded yet
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae019b010>
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_69adb6b8ac20d16329c444f6e3d6a28c.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_69adb6b8ac20d16329c444f6e3d6a28c.jpg saved to cache
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_cf2be77854a06f66554422462aec9136.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cf2be77854a06f66554422462aec9136.jpg not downloaded yet
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: BM29005
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM29005%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for BM29005: 1
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_278841305f703025a658a2137f61234b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_278841305f703025a658a2137f61234b.jpg not downloaded yet
2025-12-05 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_e3f138880fafbf173fa625930e753f39.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_13f8de7ca7096aa8af403199f9ba95ce.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a5dfd954e0374e8036bfc377582a317.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3669129a70a861172b911134268f3f36.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_b40ab75327aad0b246f75a8477d93b04.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_b40ab75327aad0b246f75a8477d93b04.jpg not downloaded yet
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: JX72433
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX72433%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for JX72433: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: HF58868
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF58868%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for HF58868: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: VC15386
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC15386%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for VC15386: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: GF05502
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05502%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for GF05502: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: KC69548
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC69548%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for KC69548: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: EL05291
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for EL05291: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: FJ86916
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ86916%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for FJ86916: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: EC73786
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC73786%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for EC73786: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: HM78467
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM78467%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for HM78467: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: XU79981
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU79981%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for XU79981: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: YH15526
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH15526%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for YH15526: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: ET69772
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET69772%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for ET69772: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: KR69258
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR69258%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for KR69258: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: SH57663
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH57663%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for SH57663: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: ZZ38543
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ38543%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for ZZ38543: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: JS87755
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for JS87755: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: TR70280
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR70280%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for TR70280: 2
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_d78d7b39ad5dc880095f895e58b81de2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d78d7b39ad5dc880095f895e58b81de2.jpg not downloaded yet
2025-12-05 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE73426/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02ded50>
2025-12-05 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_6a549fc269f9f0e2dfddf478a17d3f45.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_6a549fc269f9f0e2dfddf478a17d3f45.jpg saved to cache
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_cfe06a756efd005553d5634d0f20429c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cfe06a756efd005553d5634d0f20429c.jpg not downloaded yet
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: HB67400
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB67400%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for HB67400: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: BX65546
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX65546%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for BX65546: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: NH86693
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH86693%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for NH86693: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: FD37849
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD37849%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for FD37849: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: CE82522
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE82522%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for CE82522: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: KT64449
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64449%27 HTTP/1.1" 200 None
2025-12-05 20:03:53 [auto1.it] INFO: Scrape type for KT64449: 0
2025-12-05 20:03:53 [auto1.it] INFO: Found listing with ID: LU74910
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU74910%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for LU74910: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: BL82324
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL82324%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for BL82324: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: CB32763
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB32763%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for CB32763: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: LY90448
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY90448%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for LY90448: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: CW68051
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW68051%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for CW68051: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: ZC12313
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC12313%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for ZC12313: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: KC62935
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC62935%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for KC62935: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: DF14227
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF14227%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for DF14227: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: YB92663
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for YB92663: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: AU30700
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU30700%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for AU30700: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: WJ53867
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ53867%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for WJ53867: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: US74499
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US74499%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for US74499: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: JW97025
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW97025%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for JW97025: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: JA20233
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA20233%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for JA20233: 0
2025-12-05 20:03:54 [auto1.it] INFO: Found listing with ID: LM82104
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM82104%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [auto1.it] INFO: Scrape type for LM82104: 0
2025-12-05 20:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_d7d8b8976e20595945bef65360c9fbab.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d7d8b8976e20595945bef65360c9fbab.jpg not downloaded yet
2025-12-05 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC13600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC21681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00dd0d0>
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_e3f138880fafbf173fa625930e753f39.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_e3f138880fafbf173fa625930e753f39.jpg saved to cache
2025-12-05 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0560b50>
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_13f8de7ca7096aa8af403199f9ba95ce.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_13f8de7ca7096aa8af403199f9ba95ce.jpg saved to cache
2025-12-05 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370b910>
2025-12-05 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_9a5dfd954e0374e8036bfc377582a317.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a5dfd954e0374e8036bfc377582a317.jpg saved to cache
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01a0a50>
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_3669129a70a861172b911134268f3f36.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3669129a70a861172b911134268f3f36.jpg saved to cache
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_efa3d299f74d5a4af329f51e4cbe01c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_efa3d299f74d5a4af329f51e4cbe01c3.jpg not downloaded yet
2025-12-05 20:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF33794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cf2be77854a06f66554422462aec9136.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_a928537f3fa3f67bdd39c7b808152381.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_a928537f3fa3f67bdd39c7b808152381.jpg not downloaded yet
2025-12-05 20:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_f22a080ccde40354096f514cc266ed4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f22a080ccde40354096f514cc266ed4a.jpg not downloaded yet
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_3ff85afa4ebb6bd9821f69d32002e8a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3ff85afa4ebb6bd9821f69d32002e8a9.jpg not downloaded yet
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_f444c8406b755a210791da54bd3c0e70.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f444c8406b755a210791da54bd3c0e70.jpg not downloaded yet
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_9092b7eebabddfbe09c43c7adc32c81b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9092b7eebabddfbe09c43c7adc32c81b.jpg not downloaded yet
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04641d0>
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_cf2be77854a06f66554422462aec9136.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cf2be77854a06f66554422462aec9136.jpg saved to cache
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d78d7b39ad5dc880095f895e58b81de2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d7d8b8976e20595945bef65360c9fbab.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_4b1fd4006a5737c7d21b30d0a53f6238.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4b1fd4006a5737c7d21b30d0a53f6238.jpg not downloaded yet
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_b40ab75327aad0b246f75a8477d93b04.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cfe06a756efd005553d5634d0f20429c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_9a3a39ba4f34ebffc7f259fd69a17652.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a3a39ba4f34ebffc7f259fd69a17652.jpg not downloaded yet
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG59553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB48668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05e4a10>
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_d78d7b39ad5dc880095f895e58b81de2.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d78d7b39ad5dc880095f895e58b81de2.jpg saved to cache
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9092b7eebabddfbe09c43c7adc32c81b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4b1fd4006a5737c7d21b30d0a53f6238.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f444c8406b755a210791da54bd3c0e70.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0161ad0>
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_d7d8b8976e20595945bef65360c9fbab.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d7d8b8976e20595945bef65360c9fbab.jpg saved to cache
2025-12-05 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3ff85afa4ebb6bd9821f69d32002e8a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP94676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00d6350>
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_b40ab75327aad0b246f75a8477d93b04.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_b40ab75327aad0b246f75a8477d93b04.jpg saved to cache
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00de650>
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_cfe06a756efd005553d5634d0f20429c.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cfe06a756efd005553d5634d0f20429c.jpg saved to cache
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT71409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0260e10>
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_9092b7eebabddfbe09c43c7adc32c81b.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9092b7eebabddfbe09c43c7adc32c81b.jpg saved to cache
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00f5bd0>
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_4b1fd4006a5737c7d21b30d0a53f6238.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4b1fd4006a5737c7d21b30d0a53f6238.jpg saved to cache
2025-12-05 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3711f10>
2025-12-05 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_f444c8406b755a210791da54bd3c0e70.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f444c8406b755a210791da54bd3c0e70.jpg saved to cache
2025-12-05 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f22a080ccde40354096f514cc266ed4a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a3a39ba4f34ebffc7f259fd69a17652.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX99964> (referer: https://www.auto1.com/v1/car-details-view/LX99964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0126cd0>
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_3ff85afa4ebb6bd9821f69d32002e8a9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3ff85afa4ebb6bd9821f69d32002e8a9.jpg saved to cache
2025-12-05 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_a928537f3fa3f67bdd39c7b808152381.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA26868/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00ac150>
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_f22a080ccde40354096f514cc266ed4a.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f22a080ccde40354096f514cc266ed4a.jpg saved to cache
2025-12-05 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0145350>
2025-12-05 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_9a3a39ba4f34ebffc7f259fd69a17652.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a3a39ba4f34ebffc7f259fd69a17652.jpg saved to cache
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964
2025-12-05 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3810cb8d-87f3-5cc0-941e-685807b3fb18 with scrape type 1
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_0d79608d5ee06515045734adddcb9056.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0d79608d5ee06515045734adddcb9056.jpg not downloaded yet
2025-12-05 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_278841305f703025a658a2137f61234b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_83858e62e700b0ddcbc76734f91ffcc6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_83858e62e700b0ddcbc76734f91ffcc6.jpg not downloaded yet
2025-12-05 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_efa3d299f74d5a4af329f51e4cbe01c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM29005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA06661> (referer: https://www.auto1.com/v1/car-details-view/EA06661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_9c091d37cd68bc25d3ff946d368c3fd8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9c091d37cd68bc25d3ff946d368c3fd8.jpg not downloaded yet
2025-12-05 20:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0564d90>
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_a928537f3fa3f67bdd39c7b808152381.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_a928537f3fa3f67bdd39c7b808152381.jpg saved to cache
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:03:59 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_b1d887a9ca4c6bc058ac214713b916b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_b1d887a9ca4c6bc058ac214713b916b6.jpg not downloaded yet
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: ZD81765
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD81765%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for ZD81765: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: SR31732
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR31732%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for SR31732: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: NY39910
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY39910%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for NY39910: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: LX50050
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX50050%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for LX50050: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: WG22278
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for WG22278: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: RG34096
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG34096%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for RG34096: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: GB75182
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB75182%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for GB75182: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: HK56128
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK56128%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for HK56128: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: ZF25118
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF25118%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for ZF25118: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: SW58220
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW58220%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for SW58220: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: GY23026
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY23026%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for GY23026: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: PM40401
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM40401%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for PM40401: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: NR27447
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR27447%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for NR27447: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: HK99517
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK99517%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for HK99517: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: BM83226
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM83226%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for BM83226: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: ZD64809
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD64809%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for ZD64809: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: NS14568
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS14568%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for NS14568: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: PR20498
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR20498%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for PR20498: 0
2025-12-05 20:03:59 [auto1.it] INFO: Found listing with ID: CE05894
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE05894%27 HTTP/1.1" 200 None
2025-12-05 20:03:59 [auto1.it] INFO: Scrape type for CE05894: 2
2025-12-05 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM97428> (referer: https://www.auto1.com/v1/car-details-view/SM97428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0d79608d5ee06515045734adddcb9056.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0315350>
2025-12-05 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_278841305f703025a658a2137f61234b.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_278841305f703025a658a2137f61234b.jpg saved to cache
2025-12-05 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae06013d0>
2025-12-05 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_efa3d299f74d5a4af329f51e4cbe01c3.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_efa3d299f74d5a4af329f51e4cbe01c3.jpg saved to cache
2025-12-05 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a871e43-94d6-5c7d-8093-7d22801d0a76 with identifier: EA06661
2025-12-05 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a871e43-94d6-5c7d-8093-7d22801d0a76 with scrape type 2
2025-12-05 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a871e43-94d6-5c7d-8093-7d22801d0a76 with scrape type 2
2025-12-05 20:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a871e43-94d6-5c7d-8093-7d22801d0a76, identifier: EA06661
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_9a3da37d0cfc990a4f84a1c32e06a93b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9a3da37d0cfc990a4f84a1c32e06a93b.jpg not downloaded yet
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: AB82750
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB82750%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for AB82750: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: MD13712
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD13712%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for MD13712: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: FJ06005
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ06005%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for FJ06005: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: LH16406
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH16406%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for LH16406: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: VE23959
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23959%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for VE23959: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: CA12776
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA12776%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for CA12776: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: CP36603
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP36603%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for CP36603: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: TU05159
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU05159%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for TU05159: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: JU85214
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU85214%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for JU85214: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: TC56605
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC56605%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for TC56605: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: RE49943
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49943%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for RE49943: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: XV69031
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV69031%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for XV69031: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: GL72110
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL72110%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for GL72110: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: GW22031
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW22031%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for GW22031: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: CA23439
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA23439%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for CA23439: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: YZ75432
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ75432%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for YZ75432: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: CZ56358
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ56358%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for CZ56358: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: AF54996
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF54996%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for AF54996: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: AX48769
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX48769%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for AX48769: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: WP71679
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP71679%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for WP71679: 0
2025-12-05 20:04:01 [auto1.it] INFO: Found listing with ID: HS25644
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS25644%27 HTTP/1.1" 200 None
2025-12-05 20:04:01 [auto1.it] INFO: Scrape type for HS25644: 0
2025-12-05 20:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a871e43-94d6-5c7d-8093-7d22801d0a76 with identifier: EA06661
2025-12-05 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a871e43-94d6-5c7d-8093-7d22801d0a76 with identifier: EA06661
2025-12-05 20:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a871e43-94d6-5c7d-8093-7d22801d0a76 with identifier: EA06661 to the API
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA06661>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:12:05Z',
 'fuel_type': 'diesel',
 'id': '3a871e43-94d6-5c7d-8093-7d22801d0a76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA06661',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 92492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2020}
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA06661%27 HTTP/1.1" 200 None
2025-12-05 20:04:02 [auto1.it] INFO: Saving data for EA06661: {'auction_closing_time': 1765037525.0, 'created_time': 1764669705.453543, 'last_price_update_time': 1764965042.072925}
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA06661') HTTP/1.1" 204 0
2025-12-05 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_f354c18bc29e0d9abd188ea3f52d29e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_83858e62e700b0ddcbc76734f91ffcc6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC13600> (referer: https://www.auto1.com/v1/car-details-view/HC13600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC21681> (referer: https://www.auto1.com/v1/car-details-view/KC21681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF33794> (referer: https://www.auto1.com/v1/car-details-view/HF33794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_12c472d18abcc36ad71399e1d7c798c3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_12c472d18abcc36ad71399e1d7c798c3.jpg not downloaded yet
2025-12-05 20:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK02504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 884720b8-2296-55ae-95a9-56d0fb0f5382 with identifier: SM97428
2025-12-05 20:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 884720b8-2296-55ae-95a9-56d0fb0f5382 with scrape type 2
2025-12-05 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 884720b8-2296-55ae-95a9-56d0fb0f5382 with scrape type 2
2025-12-05 20:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 884720b8-2296-55ae-95a9-56d0fb0f5382, identifier: SM97428
2025-12-05 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0077e10>
2025-12-05 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_0d79608d5ee06515045734adddcb9056.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0d79608d5ee06515045734adddcb9056.jpg saved to cache
2025-12-05 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 884720b8-2296-55ae-95a9-56d0fb0f5382 with identifier: SM97428
2025-12-05 20:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 884720b8-2296-55ae-95a9-56d0fb0f5382 with identifier: SM97428
2025-12-05 20:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 884720b8-2296-55ae-95a9-56d0fb0f5382 with identifier: SM97428 to the API
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SM97428>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 114,
 'expiration_date': '2025-12-06T16:11:39Z',
 'fuel_type': 'petrol',
 'id': '884720b8-2296-55ae-95a9-56d0fb0f5382',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM97428',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'EVO',
 'model': '4',
 'odometer': 14668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'EVO 4 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM97428%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [auto1.it] INFO: Saving data for SM97428: {'auction_closing_time': 1765037499.0, 'created_time': 1762286607.917448, 'last_price_update_time': 1764965043.072878}
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM97428') HTTP/1.1" 204 0
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_2d777b2ce178675015905267fa4a622a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_2d777b2ce178675015905267fa4a622a.jpg not downloaded yet
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae23fd690>
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_f354c18bc29e0d9abd188ea3f52d29e2.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_f354c18bc29e0d9abd188ea3f52d29e2.jpg saved to cache
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0373890>
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_83858e62e700b0ddcbc76734f91ffcc6.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_83858e62e700b0ddcbc76734f91ffcc6.jpg saved to cache
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f33fc62f-c8d8-5869-9a6b-2c826459494d with identifier: HC13600
2025-12-05 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f33fc62f-c8d8-5869-9a6b-2c826459494d with scrape type 2
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f33fc62f-c8d8-5869-9a6b-2c826459494d with scrape type 2
2025-12-05 20:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f33fc62f-c8d8-5869-9a6b-2c826459494d, identifier: HC13600
2025-12-05 20:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19ba05b8-941c-5d8c-b02f-2aee1541ada0 with identifier: KC21681
2025-12-05 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ba05b8-941c-5d8c-b02f-2aee1541ada0 with scrape type 2
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19ba05b8-941c-5d8c-b02f-2aee1541ada0 with scrape type 2
2025-12-05 20:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 19ba05b8-941c-5d8c-b02f-2aee1541ada0, identifier: KC21681
2025-12-05 20:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b85ec7-2fb1-529b-984f-34da0ca714e2 with identifier: HF33794
2025-12-05 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b85ec7-2fb1-529b-984f-34da0ca714e2 with scrape type 1
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 41b85ec7-2fb1-529b-984f-34da0ca714e2
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_848dd37a56b11acf64fdc38ad6ab50d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_848dd37a56b11acf64fdc38ad6ab50d7.jpg already downloaded
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_e5e0fa68d75cf1029e1516b85ac00766.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_e5e0fa68d75cf1029e1516b85ac00766.jpg already downloaded
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_7500656523fbaf8109e36bb7be35d5d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7500656523fbaf8109e36bb7be35d5d9.jpg already downloaded
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_4724fdc811e461bc90adb5e7b80e1d07.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_4724fdc811e461bc90adb5e7b80e1d07.jpg already downloaded
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_c79b6f4d047740e13e66e360d5d36845.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_c79b6f4d047740e13e66e360d5d36845.jpg already downloaded
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_7415578d04aa96cdd2e12469a2441aee.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7415578d04aa96cdd2e12469a2441aee.jpg already downloaded
2025-12-05 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_0e6e6fc219efa8a3a540053f9ccd2d76.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_0e6e6fc219efa8a3a540053f9ccd2d76.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_13b5424bc84924cff55217d5ce17915e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_13b5424bc84924cff55217d5ce17915e.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_a8036b0e13c452b50c4a2134a88484b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_a8036b0e13c452b50c4a2134a88484b4.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_7b1c8810a47bf0cc0f16fb1d6d23e8b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7b1c8810a47bf0cc0f16fb1d6d23e8b7.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_2a07f0a0a34a6d962de7195d90692d32.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_2a07f0a0a34a6d962de7195d90692d32.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_f8bdb1b8d9d23d43ac84888299b72a27.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_f8bdb1b8d9d23d43ac84888299b72a27.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_ca175e689e9a2a93555a039730260f8b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_ca175e689e9a2a93555a039730260f8b.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_be1d25da1432f8620123869775e31017.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_be1d25da1432f8620123869775e31017.jpg already downloaded
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F8823a14b3c9692c112f4342ae811d716%252Fpa%252FHF33794_d8de97e3ccc882e27a173b70021cf619.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_d8de97e3ccc882e27a173b70021cf619.jpg already downloaded
2025-12-05 20:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41b85ec7-2fb1-529b-984f-34da0ca714e2, identifier: HF33794
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_40813021fcef7852c351fb2214ecc6ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40813021fcef7852c351fb2214ecc6ca.jpg not downloaded yet
2025-12-05 20:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f33fc62f-c8d8-5869-9a6b-2c826459494d with identifier: HC13600
2025-12-05 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f33fc62f-c8d8-5869-9a6b-2c826459494d with identifier: HC13600
2025-12-05 20:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f33fc62f-c8d8-5869-9a6b-2c826459494d with identifier: HC13600 to the API
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HC13600>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:35:37Z',
 'fuel_type': 'diesel',
 'id': 'f33fc62f-c8d8-5869-9a6b-2c826459494d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC13600',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 94802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC13600%27 HTTP/1.1" 200 None
2025-12-05 20:04:04 [auto1.it] INFO: Saving data for HC13600: {'auction_closing_time': 1765038937.0, 'created_time': 1762423304.712605, 'last_price_update_time': 1764965044.669616}
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HC13600') HTTP/1.1" 204 0
2025-12-05 20:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 19ba05b8-941c-5d8c-b02f-2aee1541ada0 with identifier: KC21681
2025-12-05 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 19ba05b8-941c-5d8c-b02f-2aee1541ada0 with identifier: KC21681
2025-12-05 20:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 19ba05b8-941c-5d8c-b02f-2aee1541ada0 with identifier: KC21681 to the API
2025-12-05 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KC21681>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:42:40Z',
 'fuel_type': 'diesel',
 'id': '19ba05b8-941c-5d8c-b02f-2aee1541ada0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC21681',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 120782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2017}
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC21681%27 HTTP/1.1" 200 None
2025-12-05 20:04:05 [auto1.it] INFO: Saving data for KC21681: {'auction_closing_time': 1765039360.0, 'created_time': 1763496557.700919, 'last_price_update_time': 1764965045.416655}
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC21681') HTTP/1.1" 204 0
2025-12-05 20:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41b85ec7-2fb1-529b-984f-34da0ca714e2 with identifier: HF33794
2025-12-05 20:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41b85ec7-2fb1-529b-984f-34da0ca714e2 with identifier: HF33794
2025-12-05 20:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41b85ec7-2fb1-529b-984f-34da0ca714e2 with identifier: HF33794 to the API
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HF33794>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2025-12-06T16:55:39Z',
 'fuel_type': 'hybrid',
 'id': '41b85ec7-2fb1-529b-984f-34da0ca714e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF33794',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 54954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_848dd37a56b11acf64fdc38ad6ab50d7.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_e5e0fa68d75cf1029e1516b85ac00766.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7500656523fbaf8109e36bb7be35d5d9.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_4724fdc811e461bc90adb5e7b80e1d07.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_c79b6f4d047740e13e66e360d5d36845.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7415578d04aa96cdd2e12469a2441aee.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_0e6e6fc219efa8a3a540053f9ccd2d76.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_13b5424bc84924cff55217d5ce17915e.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_a8036b0e13c452b50c4a2134a88484b4.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7b1c8810a47bf0cc0f16fb1d6d23e8b7.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_2a07f0a0a34a6d962de7195d90692d32.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_f8bdb1b8d9d23d43ac84888299b72a27.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_ca175e689e9a2a93555a039730260f8b.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_be1d25da1432f8620123869775e31017.jpg',
                'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_d8de97e3ccc882e27a173b70021cf619.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_848dd37a56b11acf64fdc38ad6ab50d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_e5e0fa68d75cf1029e1516b85ac00766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7500656523fbaf8109e36bb7be35d5d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_4724fdc811e461bc90adb5e7b80e1d07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_c79b6f4d047740e13e66e360d5d36845.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7415578d04aa96cdd2e12469a2441aee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_0e6e6fc219efa8a3a540053f9ccd2d76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2666822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_13b5424bc84924cff55217d5ce17915e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_a8036b0e13c452b50c4a2134a88484b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_7b1c8810a47bf0cc0f16fb1d6d23e8b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_2a07f0a0a34a6d962de7195d90692d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_f8bdb1b8d9d23d43ac84888299b72a27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_ca175e689e9a2a93555a039730260f8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_be1d25da1432f8620123869775e31017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b85ec7-2fb1-529b-984f-34da0ca714e2/41b85ec7-2fb1-529b-984f-34da0ca714e2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/8823a14b3c9692c112f4342ae811d716/pa/HF33794_d8de97e3ccc882e27a173b70021cf619.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2021}
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF33794%27 HTTP/1.1" 200 None
2025-12-05 20:04:05 [auto1.it] INFO: Saving data for HF33794: {'created_time': 1764965045.758291, 'last_price_update_time': 1764965045.758303, 'auction_closing_time': 1765040139.0}
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF33794') HTTP/1.1" 204 0
2025-12-05 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9a3da37d0cfc990a4f84a1c32e06a93b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9c091d37cd68bc25d3ff946d368c3fd8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_40ba3ec5410efbfea547865f009e434a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40ba3ec5410efbfea547865f009e434a.jpg not downloaded yet
2025-12-05 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR70280/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_0a4a3175e14f14b7907dbd1fcfd8b658.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0a4a3175e14f14b7907dbd1fcfd8b658.jpg not downloaded yet
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_6d768cb69444df4b57d69ce56bdfb71c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_6d768cb69444df4b57d69ce56bdfb71c.jpg not downloaded yet
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_ee10ccd47a7a981142e53ca14cf337e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_ee10ccd47a7a981142e53ca14cf337e9.jpg not downloaded yet
2025-12-05 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03ef2d0>
2025-12-05 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_9a3da37d0cfc990a4f84a1c32e06a93b.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9a3da37d0cfc990a4f84a1c32e06a93b.jpg saved to cache
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_7cd8a87572b7cdae464eeb2ee3e88d18.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_7cd8a87572b7cdae464eeb2ee3e88d18.jpg not downloaded yet
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae009d890>
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_9c091d37cd68bc25d3ff946d368c3fd8.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9c091d37cd68bc25d3ff946d368c3fd8.jpg saved to cache
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40813021fcef7852c351fb2214ecc6ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_c23b482571d9f22b9620702c91658b90.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_c23b482571d9f22b9620702c91658b90.jpg not downloaded yet
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_50a78a05dcbc0f8d8259f047cda2c603.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_50a78a05dcbc0f8d8259f047cda2c603.jpg not downloaded yet
2025-12-05 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_ee10ccd47a7a981142e53ca14cf337e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV13069> (referer: https://www.auto1.com/v1/car-details-view/PV13069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00c8910>
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_40813021fcef7852c351fb2214ecc6ca.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40813021fcef7852c351fb2214ecc6ca.jpg saved to cache
2025-12-05 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE73426> (referer: https://www.auto1.com/v1/car-details-view/EE73426/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP94676> (referer: https://www.auto1.com/v1/car-details-view/JP94676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV64817> (referer: https://www.auto1.com/v1/car-details-view/GV64817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT71409> (referer: https://www.auto1.com/v1/car-details-view/GT71409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae006c950>
2025-12-05 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_ee10ccd47a7a981142e53ca14cf337e9.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_ee10ccd47a7a981142e53ca14cf337e9.jpg saved to cache
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf52ef67-151e-5d11-a198-7d45f5e691a9 with identifier: PV13069
2025-12-05 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf52ef67-151e-5d11-a198-7d45f5e691a9 with scrape type 1
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_11b5bd7c57702adcf5638428b6e34b58.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_11b5bd7c57702adcf5638428b6e34b58.jpg not downloaded yet
2025-12-05 20:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_50a78a05dcbc0f8d8259f047cda2c603.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_3e9e1ed7fbea32ebdfae50799da6f550.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_3e9e1ed7fbea32ebdfae50799da6f550.jpg not downloaded yet
2025-12-05 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB48668> (referer: https://www.auto1.com/v1/car-details-view/BB48668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG59553> (referer: https://www.auto1.com/v1/car-details-view/KG59553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_1729c69a99f87f567a5f8733cf679660.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_1729c69a99f87f567a5f8733cf679660.jpg not downloaded yet
2025-12-05 20:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747b953e-860d-5c4a-a361-a4ff33460d85 with identifier: EE73426
2025-12-05 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747b953e-860d-5c4a-a361-a4ff33460d85 with scrape type 1
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_63429f768299b19212084ce8b8b6b189.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_63429f768299b19212084ce8b8b6b189.jpg not downloaded yet
2025-12-05 20:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c515c25-4781-50dc-a3ea-eba671a79759 with identifier: JP94676
2025-12-05 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c515c25-4781-50dc-a3ea-eba671a79759 with scrape type 1
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_539c9ce4fc5f72c28924bab4034c8a87.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_539c9ce4fc5f72c28924bab4034c8a87.jpg not downloaded yet
2025-12-05 20:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb7090c-ece9-5e6b-89dd-d44dacc37f01 with identifier: GV64817
2025-12-05 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb7090c-ece9-5e6b-89dd-d44dacc37f01 with scrape type 2
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb7090c-ece9-5e6b-89dd-d44dacc37f01 with scrape type 2
2025-12-05 20:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: abb7090c-ece9-5e6b-89dd-d44dacc37f01, identifier: GV64817
2025-12-05 20:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f782150-ff52-5c8d-8327-bcd24505617c with identifier: GT71409
2025-12-05 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f782150-ff52-5c8d-8327-bcd24505617c with scrape type 2
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f782150-ff52-5c8d-8327-bcd24505617c with scrape type 2
2025-12-05 20:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f782150-ff52-5c8d-8327-bcd24505617c, identifier: GT71409
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_78bd13bbef95ed4e7cb5c6e56d386c78.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_78bd13bbef95ed4e7cb5c6e56d386c78.jpg not downloaded yet
2025-12-05 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA26868> (referer: https://www.auto1.com/v1/car-details-view/SA26868/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: abb7090c-ece9-5e6b-89dd-d44dacc37f01 with identifier: GV64817
2025-12-05 20:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: abb7090c-ece9-5e6b-89dd-d44dacc37f01 with identifier: GV64817
2025-12-05 20:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: abb7090c-ece9-5e6b-89dd-d44dacc37f01 with identifier: GV64817 to the API
2025-12-05 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GV64817>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:25:27Z',
 'fuel_type': 'diesel',
 'id': 'abb7090c-ece9-5e6b-89dd-d44dacc37f01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV64817',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 62684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2025-12-05 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV64817%27 HTTP/1.1" 200 None
2025-12-05 20:04:08 [auto1.it] INFO: Saving data for GV64817: {'auction_closing_time': 1765038327.0, 'created_time': 1763064328.878558, 'last_price_update_time': 1764965048.172073}
2025-12-05 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV64817') HTTP/1.1" 204 0
2025-12-05 20:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f782150-ff52-5c8d-8327-bcd24505617c with identifier: GT71409
2025-12-05 20:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f782150-ff52-5c8d-8327-bcd24505617c with identifier: GT71409
2025-12-05 20:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f782150-ff52-5c8d-8327-bcd24505617c with identifier: GT71409 to the API
2025-12-05 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GT71409>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:10:39Z',
 'fuel_type': 'petrol',
 'id': '3f782150-ff52-5c8d-8327-bcd24505617c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT71409',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 17196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2022}
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT71409%27 HTTP/1.1" 200 None
2025-12-05 20:04:10 [auto1.it] INFO: Saving data for GT71409: {'auction_closing_time': 1765037439.0, 'created_time': 1762286450.055945, 'last_price_update_time': 1764965050.300183}
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT71409') HTTP/1.1" 204 0
2025-12-05 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_7cd8a87572b7cdae464eeb2ee3e88d18.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_c23b482571d9f22b9620702c91658b90.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0a4a3175e14f14b7907dbd1fcfd8b658.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_f6219d7c0be55b385a6ce0a098d4de4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_f6219d7c0be55b385a6ce0a098d4de4d.jpg not downloaded yet
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_9b08e1d75be18cfb8963545938d9cf60.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_9b08e1d75be18cfb8963545938d9cf60.jpg not downloaded yet
2025-12-05 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_6d768cb69444df4b57d69ce56bdfb71c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_11b5bd7c57702adcf5638428b6e34b58.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ab615fca59ee3a2827364d74c81e04d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ab615fca59ee3a2827364d74c81e04d4.jpg not downloaded yet
2025-12-05 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0301190>
2025-12-05 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_50a78a05dcbc0f8d8259f047cda2c603.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_50a78a05dcbc0f8d8259f047cda2c603.jpg saved to cache
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a157a0-2dc7-563b-98de-309511b4d31a with identifier: BB48668
2025-12-05 20:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a157a0-2dc7-563b-98de-309511b4d31a with scrape type 2
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03a157a0-2dc7-563b-98de-309511b4d31a with scrape type 2
2025-12-05 20:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 03a157a0-2dc7-563b-98de-309511b4d31a, identifier: BB48668
2025-12-05 20:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd46dba2-4a09-58e6-b582-4baca4085401 with identifier: KG59553
2025-12-05 20:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd46dba2-4a09-58e6-b582-4baca4085401 with scrape type 2
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd46dba2-4a09-58e6-b582-4baca4085401 with scrape type 2
2025-12-05 20:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd46dba2-4a09-58e6-b582-4baca4085401, identifier: KG59553
2025-12-05 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_3e9e1ed7fbea32ebdfae50799da6f550.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_507711231f28d57a8c283fa8665f6635.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_507711231f28d57a8c283fa8665f6635.jpg not downloaded yet
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_20725cb4449c71de8f772a8df6a912c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_20725cb4449c71de8f772a8df6a912c4.jpg not downloaded yet
2025-12-05 20:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 03a157a0-2dc7-563b-98de-309511b4d31a with identifier: BB48668
2025-12-05 20:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 03a157a0-2dc7-563b-98de-309511b4d31a with identifier: BB48668
2025-12-05 20:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 03a157a0-2dc7-563b-98de-309511b4d31a with identifier: BB48668 to the API
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BB48668>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:51:46Z',
 'fuel_type': 'petrol',
 'id': '03a157a0-2dc7-563b-98de-309511b4d31a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB48668',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 31922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2017}
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB48668%27 HTTP/1.1" 200 None
2025-12-05 20:04:11 [auto1.it] INFO: Saving data for BB48668: {'auction_closing_time': 1765039906.0, 'created_time': 1764014521.017488, 'last_price_update_time': 1764965051.290536}
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BB48668') HTTP/1.1" 204 0
2025-12-05 20:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd46dba2-4a09-58e6-b582-4baca4085401 with identifier: KG59553
2025-12-05 20:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd46dba2-4a09-58e6-b582-4baca4085401 with identifier: KG59553
2025-12-05 20:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd46dba2-4a09-58e6-b582-4baca4085401 with identifier: KG59553 to the API
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KG59553>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2025-12-06T16:54:05Z',
 'fuel_type': 'petrol',
 'id': 'dd46dba2-4a09-58e6-b582-4baca4085401',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG59553',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 82619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 M35i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG59553%27 HTTP/1.1" 200 None
2025-12-05 20:04:11 [auto1.it] INFO: Saving data for KG59553: {'auction_closing_time': 1765040045.0, 'created_time': 1762251190.42404, 'last_price_update_time': 1764965051.682005}
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KG59553') HTTP/1.1" 204 0
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ace90417d46de777eaeee4b57ff3e2af.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ace90417d46de777eaeee4b57ff3e2af.jpg not downloaded yet
2025-12-05 20:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c2f9c3-4e55-5ce3-b541-38421353307f with identifier: SA26868
2025-12-05 20:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c2f9c3-4e55-5ce3-b541-38421353307f with scrape type 1
2025-12-05 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_3b3afa9ca11048504983bddc2d271912.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3b3afa9ca11048504983bddc2d271912.jpg not downloaded yet
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_c51b12a86f61d00e0efe0a9f4dc149cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_c51b12a86f61d00e0efe0a9f4dc149cc.jpg not downloaded yet
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_b69695c96fdb917b1db402686cc3feb4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b69695c96fdb917b1db402686cc3feb4.jpg not downloaded yet
2025-12-05 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE05894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP28978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3623790>
2025-12-05 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_7cd8a87572b7cdae464eeb2ee3e88d18.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_7cd8a87572b7cdae464eeb2ee3e88d18.jpg saved to cache
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3635090>
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_c23b482571d9f22b9620702c91658b90.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_c23b482571d9f22b9620702c91658b90.jpg saved to cache
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3638110>
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_0a4a3175e14f14b7907dbd1fcfd8b658.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0a4a3175e14f14b7907dbd1fcfd8b658.jpg saved to cache
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3634f90>
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_6d768cb69444df4b57d69ce56bdfb71c.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_6d768cb69444df4b57d69ce56bdfb71c.jpg saved to cache
2025-12-05 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3624b90>
2025-12-05 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_11b5bd7c57702adcf5638428b6e34b58.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_11b5bd7c57702adcf5638428b6e34b58.jpg saved to cache
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_78bd13bbef95ed4e7cb5c6e56d386c78.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_1729c69a99f87f567a5f8733cf679660.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40ba3ec5410efbfea547865f009e434a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_6499673dc66eec2d8f7bc28aa31a76a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_6499673dc66eec2d8f7bc28aa31a76a5.jpg not downloaded yet
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_a19d1b6e3e39895a5e8a79d2f659ecce.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_a19d1b6e3e39895a5e8a79d2f659ecce.jpg not downloaded yet
2025-12-05 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_63429f768299b19212084ce8b8b6b189.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_1f0de77ac5788369a3df1dd718435bbe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_1f0de77ac5788369a3df1dd718435bbe.jpg not downloaded yet
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_118851312a37f5b101ef5b9b5492bf57.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_118851312a37f5b101ef5b9b5492bf57.jpg not downloaded yet
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00781d0>
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_3e9e1ed7fbea32ebdfae50799da6f550.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_3e9e1ed7fbea32ebdfae50799da6f550.jpg saved to cache
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_12c472d18abcc36ad71399e1d7c798c3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_693cd8dded68a6edf8f7fde60e9f6c57.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_693cd8dded68a6edf8f7fde60e9f6c57.jpg not downloaded yet
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_17661428c4426e48c70e2741a344ddea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_17661428c4426e48c70e2741a344ddea.jpg not downloaded yet
2025-12-05 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR70280> (referer: https://www.auto1.com/v1/car-details-view/TR70280/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_173b7c1a6008abcd24ee9fcc3c4a431b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_173b7c1a6008abcd24ee9fcc3c4a431b.jpg not downloaded yet
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_907fed43a4c9961fd3898d39566a4e33.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_907fed43a4c9961fd3898d39566a4e33.jpg not downloaded yet
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ece993a3f4d5603ae4d51221c0b881da.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ece993a3f4d5603ae4d51221c0b881da.jpg not downloaded yet
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_2c543f5d3e197f7df52d31054e60138d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_2c543f5d3e197f7df52d31054e60138d.jpg not downloaded yet
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e3150>
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_78bd13bbef95ed4e7cb5c6e56d386c78.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_78bd13bbef95ed4e7cb5c6e56d386c78.jpg saved to cache
2025-12-05 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0220990>
2025-12-05 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_1729c69a99f87f567a5f8733cf679660.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_1729c69a99f87f567a5f8733cf679660.jpg saved to cache
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0579b90>
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_40ba3ec5410efbfea547865f009e434a.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40ba3ec5410efbfea547865f009e434a.jpg saved to cache
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:14 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a2510>
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_63429f768299b19212084ce8b8b6b189.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_63429f768299b19212084ce8b8b6b189.jpg saved to cache
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_c51b12a86f61d00e0efe0a9f4dc149cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_5c2cc5b8263c0ec84a96d5c15d004a48.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_5c2cc5b8263c0ec84a96d5c15d004a48.jpg not downloaded yet
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_b3d75a5d7cb87df2e10282839fc126c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b3d75a5d7cb87df2e10282839fc126c8.jpg not downloaded yet
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_14fc2fd85f9d0c96f7f7e4aa653c8f6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_14fc2fd85f9d0c96f7f7e4aa653c8f6f.jpg not downloaded yet
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_48b9b0f41e5596c889cc178b616067dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_48b9b0f41e5596c889cc178b616067dd.jpg not downloaded yet
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: VL40071
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL40071%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for VL40071: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: JG92403
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG92403%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for JG92403: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: MR60103
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR60103%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for MR60103: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: SH45068
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH45068%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for SH45068: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: ZJ01897
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ01897%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for ZJ01897: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: HJ41912
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ41912%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for HJ41912: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: XL58334
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL58334%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for XL58334: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: NT50828
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT50828%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for NT50828: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: VW00442
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW00442%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for VW00442: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: PR91188
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for PR91188: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: JZ82526
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ82526%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for JZ82526: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: WZ58856
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ58856%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for WZ58856: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: ZD98375
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD98375%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for ZD98375: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: GL17856
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL17856%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for GL17856: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: SR77260
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR77260%27 HTTP/1.1" 200 None
2025-12-05 20:04:14 [auto1.it] INFO: Scrape type for SR77260: 0
2025-12-05 20:04:14 [auto1.it] INFO: Found listing with ID: AH71898
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH71898%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for AH71898: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: FX72722
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX72722%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for FX72722: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: WR35053
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR35053%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for WR35053: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: KL97300
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL97300%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for KL97300: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: BA47590
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA47590%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for BA47590: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: GK18326
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK18326%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for GK18326: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: SJ73434
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ73434%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for SJ73434: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: GY55011
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for GY55011: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: JK28026
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK28026%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for JK28026: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: RA25408
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for RA25408: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: NR57705
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR57705%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for NR57705: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: PL31323
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL31323%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for PL31323: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: PZ69908
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ69908%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for PZ69908: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: TV43098
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV43098%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for TV43098: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: YU94462
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for YU94462: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: XW54555
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW54555%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for XW54555: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: UX53135
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX53135%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for UX53135: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: RU90797
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU90797%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for RU90797: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: TY32521
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY32521%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for TY32521: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: WN75078
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN75078%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for WN75078: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: SP74056
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP74056%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for SP74056: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: NY23809
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY23809%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for NY23809: 0
2025-12-05 20:04:15 [auto1.it] INFO: Found listing with ID: DN37442
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN37442%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [auto1.it] INFO: Scrape type for DN37442: 2
2025-12-05 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_476e6732b12fd43b1969ddceb007a158.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_399b8ef5adab102e3ce31c91a83a041a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_399b8ef5adab102e3ce31c91a83a041a.jpg not downloaded yet
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_756f67bf130775fdd949ddd915c48436.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_756f67bf130775fdd949ddd915c48436.jpg not downloaded yet
2025-12-05 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM29005> (referer: https://www.auto1.com/v1/car-details-view/BM29005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0301dd0>
2025-12-05 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_12c472d18abcc36ad71399e1d7c798c3.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_12c472d18abcc36ad71399e1d7c798c3.jpg saved to cache
2025-12-05 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0598e2ce-6a28-5122-8b85-f869005db711 with identifier: TR70280
2025-12-05 20:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0598e2ce-6a28-5122-8b85-f869005db711 with scrape type 2
2025-12-05 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0598e2ce-6a28-5122-8b85-f869005db711 with scrape type 2
2025-12-05 20:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0598e2ce-6a28-5122-8b85-f869005db711, identifier: TR70280
2025-12-05 20:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ace90417d46de777eaeee4b57ff3e2af.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_bccff7426d13de0a8eaacee6ea6cbfd6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_bccff7426d13de0a8eaacee6ea6cbfd6.jpg not downloaded yet
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_8f52677b07a9d0ce824ea29198b2a889.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8f52677b07a9d0ce824ea29198b2a889.jpg not downloaded yet
2025-12-05 20:04:16 [auto1.it] INFO: Found listing with ID: FM27207
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM27207%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [auto1.it] INFO: Scrape type for FM27207: 0
2025-12-05 20:04:16 [auto1.it] INFO: Found listing with ID: PV32269
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV32269%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [auto1.it] INFO: Scrape type for PV32269: 0
2025-12-05 20:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0598e2ce-6a28-5122-8b85-f869005db711 with identifier: TR70280
2025-12-05 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0598e2ce-6a28-5122-8b85-f869005db711 with identifier: TR70280
2025-12-05 20:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0598e2ce-6a28-5122-8b85-f869005db711 with identifier: TR70280 to the API
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR70280>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:26:25Z',
 'fuel_type': 'diesel',
 'id': '0598e2ce-6a28-5122-8b85-f869005db711',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR70280',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 128661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR70280%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [auto1.it] INFO: Saving data for TR70280: {'auction_closing_time': 1765038385.0, 'created_time': 1762250795.911349, 'last_price_update_time': 1764965056.484396}
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR70280') HTTP/1.1" 204 0
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_23f2091f02506b30fdbeabb88d0f2ff8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_23f2091f02506b30fdbeabb88d0f2ff8.jpg not downloaded yet
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_7dbf9fdf768c85945757fa1ad7f9fe94.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_7dbf9fdf768c85945757fa1ad7f9fe94.jpg not downloaded yet
2025-12-05 20:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK02504> (referer: https://www.auto1.com/v1/car-details-view/FK02504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e2590>
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_c51b12a86f61d00e0efe0a9f4dc149cc.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_c51b12a86f61d00e0efe0a9f4dc149cc.jpg saved to cache
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ff77f4135b29fb3a6035ae42ca8ad77e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ff77f4135b29fb3a6035ae42ca8ad77e.jpg not downloaded yet
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_d81c04f1bfd1cc7ad5a7463582c6c4e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d81c04f1bfd1cc7ad5a7463582c6c4e6.jpg not downloaded yet
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_d5dcfb65c4176dab52478b95c8ef3740.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_d5dcfb65c4176dab52478b95c8ef3740.jpg not downloaded yet
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_2805284c8d2e40f267dd3a6c2c70421f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_2805284c8d2e40f267dd3a6c2c70421f.jpg not downloaded yet
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014e510>
2025-12-05 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_476e6732b12fd43b1969ddceb007a158.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_476e6732b12fd43b1969ddceb007a158.jpg saved to cache
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d with identifier: BM29005
2025-12-05 20:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d with scrape type 1
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_281af44381e4447820c909144511816a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_281af44381e4447820c909144511816a.jpg not downloaded yet
2025-12-05 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a5f90>
2025-12-05 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ace90417d46de777eaeee4b57ff3e2af.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ace90417d46de777eaeee4b57ff3e2af.jpg saved to cache
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_81638c2c5bc22075ac83f8349641eb51.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_81638c2c5bc22075ac83f8349641eb51.jpg not downloaded yet
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_ba3f1e9da9d55ec892d9ca7249e596df.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ba3f1e9da9d55ec892d9ca7249e596df.jpg not downloaded yet
2025-12-05 20:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dabf6ca5-0c55-5c94-9b04-2af2b03094e8 with identifier: FK02504
2025-12-05 20:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dabf6ca5-0c55-5c94-9b04-2af2b03094e8 with scrape type 2
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dabf6ca5-0c55-5c94-9b04-2af2b03094e8 with scrape type 2
2025-12-05 20:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dabf6ca5-0c55-5c94-9b04-2af2b03094e8, identifier: FK02504
2025-12-05 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_b1d887a9ca4c6bc058ac214713b916b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_507711231f28d57a8c283fa8665f6635.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_12ef52adce16948bd461f912d2a75e7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_12ef52adce16948bd461f912d2a75e7e.jpg not downloaded yet
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_76923695062454b577c7f9d5f1e52932.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_76923695062454b577c7f9d5f1e52932.jpg not downloaded yet
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_47d4931b74b7d7a380a004919dfedaea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_47d4931b74b7d7a380a004919dfedaea.jpg not downloaded yet
2025-12-05 20:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dabf6ca5-0c55-5c94-9b04-2af2b03094e8 with identifier: FK02504
2025-12-05 20:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dabf6ca5-0c55-5c94-9b04-2af2b03094e8 with identifier: FK02504
2025-12-05 20:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dabf6ca5-0c55-5c94-9b04-2af2b03094e8 with identifier: FK02504 to the API
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FK02504>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:35:53Z',
 'fuel_type': 'petrol',
 'id': 'dabf6ca5-0c55-5c94-9b04-2af2b03094e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK02504',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 43731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Seat Leon 1.5 eTSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK02504%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [auto1.it] INFO: Saving data for FK02504: {'auction_closing_time': 1765038953.0, 'created_time': 1761163252.629117, 'last_price_update_time': 1764965058.109545}
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK02504') HTTP/1.1" 204 0
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_82e5c6c408a7c50b2a7898e8c9235a6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_82e5c6c408a7c50b2a7898e8c9235a6b.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_d09e5a032b0ea6979431be744919ab4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d09e5a032b0ea6979431be744919ab4c.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_2fa4b1f1b602230f0a3740f5562afbbc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_2fa4b1f1b602230f0a3740f5562afbbc.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_61b651fbde18663e95cb6b15220bbd3f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_61b651fbde18663e95cb6b15220bbd3f.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_d9bce373bc0cde8b711dc5934c8a52a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_d9bce373bc0cde8b711dc5934c8a52a2.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_87191e7ee145148a562e400eba1d20a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_87191e7ee145148a562e400eba1d20a8.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_4f92f0d60196994e5b96bd86b0b4e912.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_4f92f0d60196994e5b96bd86b0b4e912.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_88676f6aad34f44ed9b55627ab24c665.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_88676f6aad34f44ed9b55627ab24c665.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_dd04163ac73f1d8f773e922ea4439a6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_dd04163ac73f1d8f773e922ea4439a6f.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_b5ce2693aca5c1d3f3454ead7bc81577.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b5ce2693aca5c1d3f3454ead7bc81577.jpg not downloaded yet
2025-12-05 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f15d0>
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_b1d887a9ca4c6bc058ac214713b916b6.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_b1d887a9ca4c6bc058ac214713b916b6.jpg saved to cache
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f69d0>
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_507711231f28d57a8c283fa8665f6635.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_507711231f28d57a8c283fa8665f6635.jpg saved to cache
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_fc9e31a599f7e1346db9f2c45fb48e7b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_fc9e31a599f7e1346db9f2c45fb48e7b.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_780ca4f5f72933bc037a92f51df6fd21.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_780ca4f5f72933bc037a92f51df6fd21.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_720212d7a756a4666787a922b343cddb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_720212d7a756a4666787a922b343cddb.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_5412b85b93034674861ccdd6e581c082.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_5412b85b93034674861ccdd6e581c082.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_8e910f870416ea004b6565a74bcd4d86.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8e910f870416ea004b6565a74bcd4d86.jpg not downloaded yet
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_cbf03ea3d771b27654e2efa2824f2615.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_cbf03ea3d771b27654e2efa2824f2615.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_5b8d4d5b9113fc502448f19a6e63e313.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_5b8d4d5b9113fc502448f19a6e63e313.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_9acd5acbddcc3f24636404eb97ab4292.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_9acd5acbddcc3f24636404eb97ab4292.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_3207218aef0b244bb8fe8e5cb40da8ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3207218aef0b244bb8fe8e5cb40da8ec.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_855c337a6c50ce1d904d55ba370f19e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_855c337a6c50ce1d904d55ba370f19e9.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_5942b161919e3a7f7bf30d0bfe77a7b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_5942b161919e3a7f7bf30d0bfe77a7b2.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_6a73f26907787b50dac4183e096d0a4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_6a73f26907787b50dac4183e096d0a4d.jpg not downloaded yet
2025-12-05 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_2d777b2ce178675015905267fa4a622a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_ef7e63ba16cacd06b26b3cc75d4df29e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ef7e63ba16cacd06b26b3cc75d4df29e.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_f30741486477e6b59e8d8d3bc9a88e48.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_f30741486477e6b59e8d8d3bc9a88e48.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_c4ef807fea3740e0fb5bece7e1324601.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_c4ef807fea3740e0fb5bece7e1324601.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_0ab186ddab445345c6867e65ea7013d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_0ab186ddab445345c6867e65ea7013d2.jpg not downloaded yet
2025-12-05 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_17661428c4426e48c70e2741a344ddea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_01b35003ed6adfb980b6d25a59ccdd06.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_01b35003ed6adfb980b6d25a59ccdd06.jpg not downloaded yet
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_b21af80eaa862ca36bf8eccb60ffd9a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b21af80eaa862ca36bf8eccb60ffd9a6.jpg not downloaded yet
2025-12-05 20:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01ceb50>
2025-12-05 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F90%252F6290943ccc9b6abeb279e0cf6d46e51e%252Fpa%252FLX99964_2d777b2ce178675015905267fa4a622a.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_2d777b2ce178675015905267fa4a622a.jpg saved to cache
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3810cb8d-87f3-5cc0-941e-685807b3fb18
2025-12-05 20:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3810cb8d-87f3-5cc0-941e-685807b3fb18, skipping ID generation
2025-12-05 20:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3810cb8d-87f3-5cc0-941e-685807b3fb18 with scrape type 1
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3810cb8d-87f3-5cc0-941e-685807b3fb18 from tracking dictionaries
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3810cb8d-87f3-5cc0-941e-685807b3fb18 sending to next pipeline
2025-12-05 20:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3810cb8d-87f3-5cc0-941e-685807b3fb18, identifier: LX99964
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_ba85347dfd799ed51559537295c6ac95.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_ba85347dfd799ed51559537295c6ac95.jpg not downloaded yet
2025-12-05 20:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964
2025-12-05 20:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964
2025-12-05 20:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3810cb8d-87f3-5cc0-941e-685807b3fb18 with identifier: LX99964 to the API
2025-12-05 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_2d777b2ce178675015905267fa4a622a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:12:04Z',
 'fuel_type': 'petrol',
 'id': '3810cb8d-87f3-5cc0-941e-685807b3fb18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX99964',
 'listing': 'auction',
 'location': 'IT, Segrate',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 73800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0d79608d5ee06515045734adddcb9056.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_83858e62e700b0ddcbc76734f91ffcc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9c091d37cd68bc25d3ff946d368c3fd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2995787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_b1d887a9ca4c6bc058ac214713b916b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_9a3da37d0cfc990a4f84a1c32e06a93b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_12c472d18abcc36ad71399e1d7c798c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3158301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_2d777b2ce178675015905267fa4a622a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40813021fcef7852c351fb2214ecc6ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_40ba3ec5410efbfea547865f009e434a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_0a4a3175e14f14b7907dbd1fcfd8b658.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_6d768cb69444df4b57d69ce56bdfb71c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_ee10ccd47a7a981142e53ca14cf337e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_7cd8a87572b7cdae464eeb2ee3e88d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_c23b482571d9f22b9620702c91658b90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3810cb8d-87f3-5cc0-941e-685807b3fb18/3810cb8d-87f3-5cc0-941e-685807b3fb18_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/90/6290943ccc9b6abeb279e0cf6d46e51e/pa/LX99964_50a78a05dcbc0f8d8259f047cda2c603.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2021}
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX99964%27 HTTP/1.1" 200 None
2025-12-05 20:04:20 [auto1.it] INFO: Saving data for LX99964: {'created_time': 1764965060.154172, 'last_price_update_time': 1764965060.154183, 'auction_closing_time': 1765037524.0}
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX99964') HTTP/1.1" 204 0
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_907fed43a4c9961fd3898d39566a4e33.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_320d71835ec8dc529de2b899a409d15a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_320d71835ec8dc529de2b899a409d15a.jpg not downloaded yet
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae009a190>
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_17661428c4426e48c70e2741a344ddea.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_17661428c4426e48c70e2741a344ddea.jpg saved to cache
2025-12-05 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04c99d0>
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_907fed43a4c9961fd3898d39566a4e33.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_907fed43a4c9961fd3898d39566a4e33.jpg saved to cache
2025-12-05 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3b3afa9ca11048504983bddc2d271912.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b3d75a5d7cb87df2e10282839fc126c8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_539c9ce4fc5f72c28924bab4034c8a87.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b69695c96fdb917b1db402686cc3feb4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ab615fca59ee3a2827364d74c81e04d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_9b08e1d75be18cfb8963545938d9cf60.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_20725cb4449c71de8f772a8df6a912c4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_a19d1b6e3e39895a5e8a79d2f659ecce.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022cc50>
2025-12-05 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_3b3afa9ca11048504983bddc2d271912.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3b3afa9ca11048504983bddc2d271912.jpg saved to cache
2025-12-05 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_81638c2c5bc22075ac83f8349641eb51.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_399b8ef5adab102e3ce31c91a83a041a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0155650>
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_b3d75a5d7cb87df2e10282839fc126c8.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b3d75a5d7cb87df2e10282839fc126c8.jpg saved to cache
2025-12-05 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0209f50>
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_539c9ce4fc5f72c28924bab4034c8a87.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_539c9ce4fc5f72c28924bab4034c8a87.jpg saved to cache
2025-12-05 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0155890>
2025-12-05 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_b69695c96fdb917b1db402686cc3feb4.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b69695c96fdb917b1db402686cc3feb4.jpg saved to cache
2025-12-05 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0082350>
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ab615fca59ee3a2827364d74c81e04d4.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ab615fca59ee3a2827364d74c81e04d4.jpg saved to cache
2025-12-05 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04bb150>
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_9b08e1d75be18cfb8963545938d9cf60.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_9b08e1d75be18cfb8963545938d9cf60.jpg saved to cache
2025-12-05 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01a1f50>
2025-12-05 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_20725cb4449c71de8f772a8df6a912c4.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_20725cb4449c71de8f772a8df6a912c4.jpg saved to cache
2025-12-05 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01ece10>
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_a19d1b6e3e39895a5e8a79d2f659ecce.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_a19d1b6e3e39895a5e8a79d2f659ecce.jpg saved to cache
2025-12-05 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:23 [scrapy.extensions.logstats] INFO: Crawled 307 pages (at 65 pages/min), scraped 97 items (at 21 items/min)
2025-12-05 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_320d71835ec8dc529de2b899a409d15a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37250d0>
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_81638c2c5bc22075ac83f8349641eb51.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_81638c2c5bc22075ac83f8349641eb51.jpg saved to cache
2025-12-05 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f7150>
2025-12-05 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_399b8ef5adab102e3ce31c91a83a041a.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_399b8ef5adab102e3ce31c91a83a041a.jpg saved to cache
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b21af80eaa862ca36bf8eccb60ffd9a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363c6d0>
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_320d71835ec8dc529de2b899a409d15a.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_320d71835ec8dc529de2b899a409d15a.jpg saved to cache
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_01b35003ed6adfb980b6d25a59ccdd06.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_c4ef807fea3740e0fb5bece7e1324601.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363ff10>
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_b21af80eaa862ca36bf8eccb60ffd9a6.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b21af80eaa862ca36bf8eccb60ffd9a6.jpg saved to cache
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_f30741486477e6b59e8d8d3bc9a88e48.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ef7e63ba16cacd06b26b3cc75d4df29e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae010f150>
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_01b35003ed6adfb980b6d25a59ccdd06.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_01b35003ed6adfb980b6d25a59ccdd06.jpg saved to cache
2025-12-05 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0145b10>
2025-12-05 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_c4ef807fea3740e0fb5bece7e1324601.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_c4ef807fea3740e0fb5bece7e1324601.jpg saved to cache
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_6a73f26907787b50dac4183e096d0a4d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_855c337a6c50ce1d904d55ba370f19e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0318690>
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_f30741486477e6b59e8d8d3bc9a88e48.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_f30741486477e6b59e8d8d3bc9a88e48.jpg saved to cache
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae015e890>
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_ef7e63ba16cacd06b26b3cc75d4df29e.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ef7e63ba16cacd06b26b3cc75d4df29e.jpg saved to cache
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_9acd5acbddcc3f24636404eb97ab4292.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3207218aef0b244bb8fe8e5cb40da8ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae055ac10>
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_6a73f26907787b50dac4183e096d0a4d.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_6a73f26907787b50dac4183e096d0a4d.jpg saved to cache
2025-12-05 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0394e90>
2025-12-05 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_855c337a6c50ce1d904d55ba370f19e9.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_855c337a6c50ce1d904d55ba370f19e9.jpg saved to cache
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_5b8d4d5b9113fc502448f19a6e63e313.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8f52677b07a9d0ce824ea29198b2a889.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_756f67bf130775fdd949ddd915c48436.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b6290>
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_9acd5acbddcc3f24636404eb97ab4292.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_9acd5acbddcc3f24636404eb97ab4292.jpg saved to cache
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f7c90>
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_3207218aef0b244bb8fe8e5cb40da8ec.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3207218aef0b244bb8fe8e5cb40da8ec.jpg saved to cache
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8e910f870416ea004b6565a74bcd4d86.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_cbf03ea3d771b27654e2efa2824f2615.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_0ab186ddab445345c6867e65ea7013d2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ba3f1e9da9d55ec892d9ca7249e596df.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b6a50>
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_5b8d4d5b9113fc502448f19a6e63e313.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_5b8d4d5b9113fc502448f19a6e63e313.jpg saved to cache
2025-12-05 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0189f50>
2025-12-05 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_8f52677b07a9d0ce824ea29198b2a889.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8f52677b07a9d0ce824ea29198b2a889.jpg saved to cache
2025-12-05 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae061fcd0>
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_756f67bf130775fdd949ddd915c48436.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_756f67bf130775fdd949ddd915c48436.jpg saved to cache
2025-12-05 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_ba85347dfd799ed51559537295c6ac95.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_5942b161919e3a7f7bf30d0bfe77a7b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_780ca4f5f72933bc037a92f51df6fd21.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0075950>
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_8e910f870416ea004b6565a74bcd4d86.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8e910f870416ea004b6565a74bcd4d86.jpg saved to cache
2025-12-05 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a2550>
2025-12-05 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_cbf03ea3d771b27654e2efa2824f2615.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_cbf03ea3d771b27654e2efa2824f2615.jpg saved to cache
2025-12-05 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f69d0>
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_0ab186ddab445345c6867e65ea7013d2.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_0ab186ddab445345c6867e65ea7013d2.jpg saved to cache
2025-12-05 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01fa3d0>
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_ba3f1e9da9d55ec892d9ca7249e596df.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ba3f1e9da9d55ec892d9ca7249e596df.jpg saved to cache
2025-12-05 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_fc9e31a599f7e1346db9f2c45fb48e7b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_88676f6aad34f44ed9b55627ab24c665.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_dd04163ac73f1d8f773e922ea4439a6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0511a10>
2025-12-05 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_ba85347dfd799ed51559537295c6ac95.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_ba85347dfd799ed51559537295c6ac95.jpg saved to cache
2025-12-05 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a4450>
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_5942b161919e3a7f7bf30d0bfe77a7b2.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_5942b161919e3a7f7bf30d0bfe77a7b2.jpg saved to cache
2025-12-05 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f0d90>
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_780ca4f5f72933bc037a92f51df6fd21.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_780ca4f5f72933bc037a92f51df6fd21.jpg saved to cache
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0449f10>
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_fc9e31a599f7e1346db9f2c45fb48e7b.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_fc9e31a599f7e1346db9f2c45fb48e7b.jpg saved to cache
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056f050>
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_88676f6aad34f44ed9b55627ab24c665.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_88676f6aad34f44ed9b55627ab24c665.jpg saved to cache
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04cafd0>
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_dd04163ac73f1d8f773e922ea4439a6f.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_dd04163ac73f1d8f773e922ea4439a6f.jpg saved to cache
2025-12-05 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_5412b85b93034674861ccdd6e581c082.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_720212d7a756a4666787a922b343cddb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b5ce2693aca5c1d3f3454ead7bc81577.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_4f92f0d60196994e5b96bd86b0b4e912.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_2fa4b1f1b602230f0a3740f5562afbbc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_82e5c6c408a7c50b2a7898e8c9235a6b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_12ef52adce16948bd461f912d2a75e7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0132750>
2025-12-05 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_5412b85b93034674861ccdd6e581c082.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_5412b85b93034674861ccdd6e581c082.jpg saved to cache
2025-12-05 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_d9bce373bc0cde8b711dc5934c8a52a2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_87191e7ee145148a562e400eba1d20a8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e6290>
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_720212d7a756a4666787a922b343cddb.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_720212d7a756a4666787a922b343cddb.jpg saved to cache
2025-12-05 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae061dad0>
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_b5ce2693aca5c1d3f3454ead7bc81577.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b5ce2693aca5c1d3f3454ead7bc81577.jpg saved to cache
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae010efd0>
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_4f92f0d60196994e5b96bd86b0b4e912.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_4f92f0d60196994e5b96bd86b0b4e912.jpg saved to cache
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0144690>
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_2fa4b1f1b602230f0a3740f5562afbbc.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_2fa4b1f1b602230f0a3740f5562afbbc.jpg saved to cache
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0069990>
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_82e5c6c408a7c50b2a7898e8c9235a6b.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_82e5c6c408a7c50b2a7898e8c9235a6b.jpg saved to cache
2025-12-05 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae010f050>
2025-12-05 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_12ef52adce16948bd461f912d2a75e7e.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_12ef52adce16948bd461f912d2a75e7e.jpg saved to cache
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d81c04f1bfd1cc7ad5a7463582c6c4e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_d5dcfb65c4176dab52478b95c8ef3740.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056a5d0>
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_d9bce373bc0cde8b711dc5934c8a52a2.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_d9bce373bc0cde8b711dc5934c8a52a2.jpg saved to cache
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0190e90>
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_87191e7ee145148a562e400eba1d20a8.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_87191e7ee145148a562e400eba1d20a8.jpg saved to cache
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01efbd0>
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_d81c04f1bfd1cc7ad5a7463582c6c4e6.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d81c04f1bfd1cc7ad5a7463582c6c4e6.jpg saved to cache
2025-12-05 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0082d10>
2025-12-05 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_d5dcfb65c4176dab52478b95c8ef3740.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_d5dcfb65c4176dab52478b95c8ef3740.jpg saved to cache
2025-12-05 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_7dbf9fdf768c85945757fa1ad7f9fe94.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d09e5a032b0ea6979431be744919ab4c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_61b651fbde18663e95cb6b15220bbd3f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_47d4931b74b7d7a380a004919dfedaea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_76923695062454b577c7f9d5f1e52932.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_281af44381e4447820c909144511816a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ff77f4135b29fb3a6035ae42ca8ad77e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_2805284c8d2e40f267dd3a6c2c70421f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_bccff7426d13de0a8eaacee6ea6cbfd6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_14fc2fd85f9d0c96f7f7e4aa653c8f6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_5c2cc5b8263c0ec84a96d5c15d004a48.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0081e90>
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_7dbf9fdf768c85945757fa1ad7f9fe94.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_7dbf9fdf768c85945757fa1ad7f9fe94.jpg saved to cache
2025-12-05 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_23f2091f02506b30fdbeabb88d0f2ff8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02209d0>
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_d09e5a032b0ea6979431be744919ab4c.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d09e5a032b0ea6979431be744919ab4c.jpg saved to cache
2025-12-05 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e0550>
2025-12-05 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_61b651fbde18663e95cb6b15220bbd3f.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_61b651fbde18663e95cb6b15220bbd3f.jpg saved to cache
2025-12-05 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370eb50>
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_47d4931b74b7d7a380a004919dfedaea.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_47d4931b74b7d7a380a004919dfedaea.jpg saved to cache
2025-12-05 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04bd5d0>
2025-12-05 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_76923695062454b577c7f9d5f1e52932.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_76923695062454b577c7f9d5f1e52932.jpg saved to cache
2025-12-05 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370f790>
2025-12-05 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F3d%252F393d6085e1b07d182c15faade7d947a6%252Fpa%252FBM29005_281af44381e4447820c909144511816a.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_281af44381e4447820c909144511816a.jpg saved to cache
2025-12-05 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d
2025-12-05 20:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d, skipping ID generation
2025-12-05 20:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d with scrape type 1
2025-12-05 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d from tracking dictionaries
2025-12-05 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d sending to next pipeline
2025-12-05 20:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d, identifier: BM29005
2025-12-05 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0435790>
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ff77f4135b29fb3a6035ae42ca8ad77e.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ff77f4135b29fb3a6035ae42ca8ad77e.jpg saved to cache
2025-12-05 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02bd4d0>
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_2805284c8d2e40f267dd3a6c2c70421f.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_2805284c8d2e40f267dd3a6c2c70421f.jpg saved to cache
2025-12-05 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a52d0>
2025-12-05 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_bccff7426d13de0a8eaacee6ea6cbfd6.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_bccff7426d13de0a8eaacee6ea6cbfd6.jpg saved to cache
2025-12-05 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02dfcd0>
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_14fc2fd85f9d0c96f7f7e4aa653c8f6f.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_14fc2fd85f9d0c96f7f7e4aa653c8f6f.jpg saved to cache
2025-12-05 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0059b90>
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_5c2cc5b8263c0ec84a96d5c15d004a48.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_5c2cc5b8263c0ec84a96d5c15d004a48.jpg saved to cache
2025-12-05 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d with identifier: BM29005
2025-12-05 20:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d with identifier: BM29005
2025-12-05 20:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d with identifier: BM29005 to the API
2025-12-05 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_281af44381e4447820c909144511816a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:19:31Z',
 'fuel_type': 'petrol',
 'id': '6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM29005',
 'listing': 'auction',
 'location': 'IT, Treviso',
 'make': 'DS Automobiles',
 'model': 'DS3',
 'odometer': 137717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_281af44381e4447820c909144511816a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2300825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_47d4931b74b7d7a380a004919dfedaea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_d9bce373bc0cde8b711dc5934c8a52a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2308133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b5ce2693aca5c1d3f3454ead7bc81577.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_5412b85b93034674861ccdd6e581c082.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_9acd5acbddcc3f24636404eb97ab4292.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_855c337a6c50ce1d904d55ba370f19e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_6a73f26907787b50dac4183e096d0a4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_f30741486477e6b59e8d8d3bc9a88e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_c4ef807fea3740e0fb5bece7e1324601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2733077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_0ab186ddab445345c6867e65ea7013d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_01b35003ed6adfb980b6d25a59ccdd06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_b21af80eaa862ca36bf8eccb60ffd9a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_ba85347dfd799ed51559537295c6ac95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d/6fd02ac7-dab4-5d63-8d1d-1549c0f0d07d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/3d/393d6085e1b07d182c15faade7d947a6/pa/BM29005_320d71835ec8dc529de2b899a409d15a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 1.2 PureTech SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2018}
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM29005%27 HTTP/1.1" 200 None
2025-12-05 20:04:39 [auto1.it] INFO: Saving data for BM29005: {'created_time': 1764965079.583214, 'last_price_update_time': 1764965079.583224, 'auction_closing_time': 1765037971.0}
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BM29005') HTTP/1.1" 204 0
2025-12-05 20:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00e3990>
2025-12-05 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_23f2091f02506b30fdbeabb88d0f2ff8.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_23f2091f02506b30fdbeabb88d0f2ff8.jpg saved to cache
2025-12-05 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_48b9b0f41e5596c889cc178b616067dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_693cd8dded68a6edf8f7fde60e9f6c57.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_173b7c1a6008abcd24ee9fcc3c4a431b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_1f0de77ac5788369a3df1dd718435bbe.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_f6219d7c0be55b385a6ce0a098d4de4d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_c72e7fbdc33fad5623dc5c81e3991f99.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0523ad0>
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_48b9b0f41e5596c889cc178b616067dd.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_48b9b0f41e5596c889cc178b616067dd.jpg saved to cache
2025-12-05 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_d82614331626db62b351bbb3623f5d5f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_4a86fa14e8da386d0faf7fba2af4dcc2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_87127f6cb55b70392287e9561c8a8f6d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4d404ba2e0d36a3a89a426aaca2bc5ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN37442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f3790>
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_693cd8dded68a6edf8f7fde60e9f6c57.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_693cd8dded68a6edf8f7fde60e9f6c57.jpg saved to cache
2025-12-05 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0125cd0>
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_173b7c1a6008abcd24ee9fcc3c4a431b.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_173b7c1a6008abcd24ee9fcc3c4a431b.jpg saved to cache
2025-12-05 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae034bd10>
2025-12-05 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_1f0de77ac5788369a3df1dd718435bbe.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_1f0de77ac5788369a3df1dd718435bbe.jpg saved to cache
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0144e50>
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F94%252F4f9422dedb33282ca9cf5a003be6a38e%252Fpa%252FEE73426_f6219d7c0be55b385a6ce0a098d4de4d.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_f6219d7c0be55b385a6ce0a098d4de4d.jpg saved to cache
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747b953e-860d-5c4a-a361-a4ff33460d85
2025-12-05 20:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747b953e-860d-5c4a-a361-a4ff33460d85, skipping ID generation
2025-12-05 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747b953e-860d-5c4a-a361-a4ff33460d85 with scrape type 1
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 747b953e-860d-5c4a-a361-a4ff33460d85 from tracking dictionaries
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747b953e-860d-5c4a-a361-a4ff33460d85 sending to next pipeline
2025-12-05 20:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 747b953e-860d-5c4a-a361-a4ff33460d85, identifier: EE73426
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0513210>
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_c72e7fbdc33fad5623dc5c81e3991f99.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_c72e7fbdc33fad5623dc5c81e3991f99.jpg saved to cache
2025-12-05 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 747b953e-860d-5c4a-a361-a4ff33460d85 with identifier: EE73426
2025-12-05 20:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 747b953e-860d-5c4a-a361-a4ff33460d85 with identifier: EE73426
2025-12-05 20:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 747b953e-860d-5c4a-a361-a4ff33460d85 with identifier: EE73426 to the API
2025-12-05 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_f6219d7c0be55b385a6ce0a098d4de4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:00:41Z',
 'fuel_type': 'petrol',
 'id': '747b953e-860d-5c4a-a361-a4ff33460d85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE73426',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 57134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_63429f768299b19212084ce8b8b6b189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_f6219d7c0be55b385a6ce0a098d4de4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_507711231f28d57a8c283fa8665f6635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_c51b12a86f61d00e0efe0a9f4dc149cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_1f0de77ac5788369a3df1dd718435bbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_173b7c1a6008abcd24ee9fcc3c4a431b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_5c2cc5b8263c0ec84a96d5c15d004a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_399b8ef5adab102e3ce31c91a83a041a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_23f2091f02506b30fdbeabb88d0f2ff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_d5dcfb65c4176dab52478b95c8ef3740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_12ef52adce16948bd461f912d2a75e7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_2fa4b1f1b602230f0a3740f5562afbbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_88676f6aad34f44ed9b55627ab24c665.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_780ca4f5f72933bc037a92f51df6fd21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747b953e-860d-5c4a-a361-a4ff33460d85/747b953e-860d-5c4a-a361-a4ff33460d85_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/94/4f9422dedb33282ca9cf5a003be6a38e/pa/EE73426_cbf03ea3d771b27654e2efa2824f2615.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Leon 1.5 eTSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE73426%27 HTTP/1.1" 200 None
2025-12-05 20:04:42 [auto1.it] INFO: Saving data for EE73426: {'created_time': 1764965082.18577, 'last_price_update_time': 1764965082.185781, 'auction_closing_time': 1765036841.0}
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE73426') HTTP/1.1" 204 0
2025-12-05 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP28978> (referer: https://www.auto1.com/v1/car-details-view/DP28978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_af01a048616e2e517876dfc0d259a6fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE05894> (referer: https://www.auto1.com/v1/car-details-view/CE05894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02ec950>
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_d82614331626db62b351bbb3623f5d5f.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_d82614331626db62b351bbb3623f5d5f.jpg saved to cache
2025-12-05 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0472fd0>
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_4a86fa14e8da386d0faf7fba2af4dcc2.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_4a86fa14e8da386d0faf7fba2af4dcc2.jpg saved to cache
2025-12-05 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0314c90>
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_87127f6cb55b70392287e9561c8a8f6d.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_87127f6cb55b70392287e9561c8a8f6d.jpg saved to cache
2025-12-05 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0611910>
2025-12-05 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5f%252F8b5f803dd56882d1b5140fd3b61998fb%252Fpa%252FVF92545_4d404ba2e0d36a3a89a426aaca2bc5ed.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4d404ba2e0d36a3a89a426aaca2bc5ed.jpg saved to cache
2025-12-05 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 572dbbcd-81e9-524d-84f9-f02812f568db
2025-12-05 20:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 572dbbcd-81e9-524d-84f9-f02812f568db, skipping ID generation
2025-12-05 20:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572dbbcd-81e9-524d-84f9-f02812f568db with scrape type 1
2025-12-05 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 572dbbcd-81e9-524d-84f9-f02812f568db from tracking dictionaries
2025-12-05 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 572dbbcd-81e9-524d-84f9-f02812f568db sending to next pipeline
2025-12-05 20:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 572dbbcd-81e9-524d-84f9-f02812f568db, identifier: VF92545
2025-12-05 20:04:43 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545
2025-12-05 20:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545
2025-12-05 20:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545 to the API
2025-12-05 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4d404ba2e0d36a3a89a426aaca2bc5ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:11:40Z',
 'fuel_type': 'diesel',
 'id': '572dbbcd-81e9-524d-84f9-f02812f568db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF92545',
 'listing': 'auction',
 'location': 'IT, Pompei',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 31538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_d82614331626db62b351bbb3623f5d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3669129a70a861172b911134268f3f36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a5dfd954e0374e8036bfc377582a317.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4d404ba2e0d36a3a89a426aaca2bc5ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_476e6732b12fd43b1969ddceb007a158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cf2be77854a06f66554422462aec9136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_b40ab75327aad0b246f75a8477d93b04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_cfe06a756efd005553d5634d0f20429c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_efa3d299f74d5a4af329f51e4cbe01c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f22a080ccde40354096f514cc266ed4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_3ff85afa4ebb6bd9821f69d32002e8a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_f444c8406b755a210791da54bd3c0e70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9092b7eebabddfbe09c43c7adc32c81b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_4b1fd4006a5737c7d21b30d0a53f6238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572dbbcd-81e9-524d-84f9-f02812f568db/572dbbcd-81e9-524d-84f9-f02812f568db_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/5f/8b5f803dd56882d1b5140fd3b61998fb/pa/VF92545_9a3a39ba4f34ebffc7f259fd69a17652.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2022}
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2025-12-05 20:04:44 [auto1.it] INFO: Saving data for VF92545: {'created_time': 1764965084.532516, 'last_price_update_time': 1764965084.532525, 'auction_closing_time': 1765037500.0}
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF92545') HTTP/1.1" 204 0
2025-12-05 20:04:44 [auto1.it] INFO: Found listing with ID: UL79452
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL79452%27 HTTP/1.1" 200 None
2025-12-05 20:04:44 [auto1.it] INFO: Scrape type for UL79452: 0
2025-12-05 20:04:44 [auto1.it] INFO: Found listing with ID: DB84846
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB84846%27 HTTP/1.1" 200 None
2025-12-05 20:04:44 [auto1.it] INFO: Scrape type for DB84846: 0
2025-12-05 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW70541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP46319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP67985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a198e5-cb7a-5e24-a6e2-812de56febdc with identifier: DP28978
2025-12-05 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a198e5-cb7a-5e24-a6e2-812de56febdc with scrape type 1
2025-12-05 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_714f4d8c79bdbf764e7adc8e0213a013.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_714f4d8c79bdbf764e7adc8e0213a013.jpg not downloaded yet
2025-12-05 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3613690>
2025-12-05 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fe1%252F94e18948abe8bef3d9b4f8234baf8162%252Fpa%252FLN66552_af01a048616e2e517876dfc0d259a6fa.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_af01a048616e2e517876dfc0d259a6fa.jpg saved to cache
2025-12-05 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286
2025-12-05 20:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a9664c0-1e5e-5a04-aa81-c61e014f9286, skipping ID generation
2025-12-05 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286 with scrape type 1
2025-12-05 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a9664c0-1e5e-5a04-aa81-c61e014f9286 from tracking dictionaries
2025-12-05 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a9664c0-1e5e-5a04-aa81-c61e014f9286 sending to next pipeline
2025-12-05 20:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a9664c0-1e5e-5a04-aa81-c61e014f9286, identifier: LN66552
2025-12-05 20:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5936c0c-a8a1-5520-b34e-4a8ced4dd8b1 with identifier: CE05894
2025-12-05 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5936c0c-a8a1-5520-b34e-4a8ced4dd8b1 with scrape type 2
2025-12-05 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5936c0c-a8a1-5520-b34e-4a8ced4dd8b1 with scrape type 2
2025-12-05 20:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d5936c0c-a8a1-5520-b34e-4a8ced4dd8b1, identifier: CE05894
2025-12-05 20:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a9664c0-1e5e-5a04-aa81-c61e014f9286 with identifier: LN66552
2025-12-05 20:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a9664c0-1e5e-5a04-aa81-c61e014f9286 with identifier: LN66552
2025-12-05 20:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a9664c0-1e5e-5a04-aa81-c61e014f9286 with identifier: LN66552 to the API
2025-12-05 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_af01a048616e2e517876dfc0d259a6fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 218,
 'expiration_date': '2025-12-06T16:46:08Z',
 'fuel_type': 'hybrid',
 'id': '1a9664c0-1e5e-5a04-aa81-c61e014f9286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN66552',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 61727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_40c46d39038bfd5c0dbf690137476193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_af01a048616e2e517876dfc0d259a6fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_4a86fa14e8da386d0faf7fba2af4dcc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_aa8363d1f95d715e0c874e7581dcef4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_69adb6b8ac20d16329c444f6e3d6a28c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_87127f6cb55b70392287e9561c8a8f6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_6a549fc269f9f0e2dfddf478a17d3f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_13f8de7ca7096aa8af403199f9ba95ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_e3f138880fafbf173fa625930e753f39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_c72e7fbdc33fad5623dc5c81e3991f99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_f354c18bc29e0d9abd188ea3f52d29e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_278841305f703025a658a2137f61234b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d78d7b39ad5dc880095f895e58b81de2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_d7d8b8976e20595945bef65360c9fbab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9664c0-1e5e-5a04-aa81-c61e014f9286/1a9664c0-1e5e-5a04-aa81-c61e014f9286_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/e1/94e18948abe8bef3d9b4f8234baf8162/pa/LN66552_a928537f3fa3f67bdd39c7b808152381.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Black Edition',
 'transmission': 'automatic',
 'trim': '4x2 Black Edition',
 'year': 2021}
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66552%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [auto1.it] INFO: Saving data for LN66552: {'created_time': 1764965086.04765, 'last_price_update_time': 1764965086.04766, 'auction_closing_time': 1765039568.0}
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN66552') HTTP/1.1" 204 0
2025-12-05 20:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d5936c0c-a8a1-5520-b34e-4a8ced4dd8b1 with identifier: CE05894
2025-12-05 20:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d5936c0c-a8a1-5520-b34e-4a8ced4dd8b1 with identifier: CE05894
2025-12-05 20:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d5936c0c-a8a1-5520-b34e-4a8ced4dd8b1 with identifier: CE05894 to the API
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE05894>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2025-12-06T16:18:44Z',
 'fuel_type': 'diesel',
 'id': 'd5936c0c-a8a1-5520-b34e-4a8ced4dd8b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE05894',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 135056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE05894%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [auto1.it] INFO: Saving data for CE05894: {'auction_closing_time': 1765037924.0, 'created_time': 1761818732.706792, 'last_price_update_time': 1764965086.483608}
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE05894') HTTP/1.1" 204 0
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_520c831ba0c9aec567555bafc0403a05.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_520c831ba0c9aec567555bafc0403a05.jpg not downloaded yet
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY92784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL99717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_b5f07a46c4a1eeda1361112b2b074ee1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_b5f07a46c4a1eeda1361112b2b074ee1.jpg not downloaded yet
2025-12-05 20:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_d062a564b9c4cd176f67ee3dc460d291.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_d062a564b9c4cd176f67ee3dc460d291.jpg not downloaded yet
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_9febeb9bb542d60c9d8b41b329c632ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9febeb9bb542d60c9d8b41b329c632ca.jpg not downloaded yet
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_a2078874e5685266d75d0afb7265443d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2078874e5685266d75d0afb7265443d.jpg not downloaded yet
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ70755/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_7c59fd190daf05b565e8d41bedc765e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_7c59fd190daf05b565e8d41bedc765e1.jpg not downloaded yet
2025-12-05 20:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ece993a3f4d5603ae4d51221c0b881da.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_714f4d8c79bdbf764e7adc8e0213a013.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_520c831ba0c9aec567555bafc0403a05.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_2bef3957c92570bf17dd812b76c91da9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2bef3957c92570bf17dd812b76c91da9.jpg not downloaded yet
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_9fa658ab81904f2de0716f6adbedd2b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9fa658ab81904f2de0716f6adbedd2b1.jpg not downloaded yet
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_6499673dc66eec2d8f7bc28aa31a76a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_2eeac9871dc15c2d34dbbdf7e00e3e2c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2eeac9871dc15c2d34dbbdf7e00e3e2c.jpg not downloaded yet
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_0023e7b952b6d6ebe7ee9e318558c62c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0023e7b952b6d6ebe7ee9e318558c62c.jpg not downloaded yet
2025-12-05 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_2c543f5d3e197f7df52d31054e60138d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_a2927594d54542cbd68b3008f074eb15.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2927594d54542cbd68b3008f074eb15.jpg not downloaded yet
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_9c03d1f8b7915b3c96e172f459dd5dff.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9c03d1f8b7915b3c96e172f459dd5dff.jpg not downloaded yet
2025-12-05 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b4090>
2025-12-05 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_ece993a3f4d5603ae4d51221c0b881da.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ece993a3f4d5603ae4d51221c0b881da.jpg saved to cache
2025-12-05 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0521150>
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_714f4d8c79bdbf764e7adc8e0213a013.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_714f4d8c79bdbf764e7adc8e0213a013.jpg saved to cache
2025-12-05 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0370950>
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_520c831ba0c9aec567555bafc0403a05.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_520c831ba0c9aec567555bafc0403a05.jpg saved to cache
2025-12-05 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_c313e2aee5d1f34e9bac2668c1a50fda.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_c313e2aee5d1f34e9bac2668c1a50fda.jpg not downloaded yet
2025-12-05 20:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2bef3957c92570bf17dd812b76c91da9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b4750>
2025-12-05 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0e%252F370e00a23d434c5409db845643fe7c00%252Fpa%252FPV13069_6499673dc66eec2d8f7bc28aa31a76a5.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_6499673dc66eec2d8f7bc28aa31a76a5.jpg saved to cache
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf52ef67-151e-5d11-a198-7d45f5e691a9
2025-12-05 20:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf52ef67-151e-5d11-a198-7d45f5e691a9, skipping ID generation
2025-12-05 20:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf52ef67-151e-5d11-a198-7d45f5e691a9 with scrape type 1
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf52ef67-151e-5d11-a198-7d45f5e691a9 from tracking dictionaries
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf52ef67-151e-5d11-a198-7d45f5e691a9 sending to next pipeline
2025-12-05 20:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf52ef67-151e-5d11-a198-7d45f5e691a9, identifier: PV13069
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_0e4d5c6807adebee425825db67b6ca6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0e4d5c6807adebee425825db67b6ca6e.jpg not downloaded yet
2025-12-05 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA46631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ96401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB16740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf52ef67-151e-5d11-a198-7d45f5e691a9 with identifier: PV13069
2025-12-05 20:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf52ef67-151e-5d11-a198-7d45f5e691a9 with identifier: PV13069
2025-12-05 20:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172638 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172638
2025-12-05 20:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cf52ef67-151e-5d11-a198-7d45f5e691a9 spider: auto1.it
2025-12-05 20:04:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: cf52ef67-151e-5d11-a198-7d45f5e691a9 due to rule: high_mileage_for_country.json, error: 172638 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172638
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:44:01Z',
 'fuel_type': 'diesel',
 'id': 'cf52ef67-151e-5d11-a198-7d45f5e691a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV13069',
 'listing': 'auction',
 'location': 'IT, Varese',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 172638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_11b5bd7c57702adcf5638428b6e34b58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_3e9e1ed7fbea32ebdfae50799da6f550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_1729c69a99f87f567a5f8733cf679660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_78bd13bbef95ed4e7cb5c6e56d386c78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2129029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ab615fca59ee3a2827364d74c81e04d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ace90417d46de777eaeee4b57ff3e2af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2127528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_6499673dc66eec2d8f7bc28aa31a76a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_693cd8dded68a6edf8f7fde60e9f6c57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2173558,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ece993a3f4d5603ae4d51221c0b881da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_14fc2fd85f9d0c96f7f7e4aa653c8f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_bccff7426d13de0a8eaacee6ea6cbfd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2286914,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_ff77f4135b29fb3a6035ae42ca8ad77e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_81638c2c5bc22075ac83f8349641eb51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_82e5c6c408a7c50b2a7898e8c9235a6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf52ef67-151e-5d11-a198-7d45f5e691a9/cf52ef67-151e-5d11-a198-7d45f5e691a9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0e/370e00a23d434c5409db845643fe7c00/pa/PV13069_87191e7ee145148a562e400eba1d20a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV13069%27 HTTP/1.1" 200 None
2025-12-05 20:04:48 [auto1.it] INFO: Saving data for PV13069: {'created_time': 1764965088.531484, 'last_price_update_time': 1764965088.531497, 'auction_closing_time': 1765039441.0}
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV13069') HTTP/1.1" 204 0
2025-12-05 20:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e3c50>
2025-12-05 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a7b4a7cb70c1e1471236c887a5294%252Fpa%252FSA26868_2c543f5d3e197f7df52d31054e60138d.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_2c543f5d3e197f7df52d31054e60138d.jpg saved to cache
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40c2f9c3-4e55-5ce3-b541-38421353307f
2025-12-05 20:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40c2f9c3-4e55-5ce3-b541-38421353307f, skipping ID generation
2025-12-05 20:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c2f9c3-4e55-5ce3-b541-38421353307f with scrape type 1
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40c2f9c3-4e55-5ce3-b541-38421353307f from tracking dictionaries
2025-12-05 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40c2f9c3-4e55-5ce3-b541-38421353307f sending to next pipeline
2025-12-05 20:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40c2f9c3-4e55-5ce3-b541-38421353307f, identifier: SA26868
2025-12-05 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_118851312a37f5b101ef5b9b5492bf57.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF20385> (referer: https://www.auto1.com/v1/car-details-view/AF20385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40c2f9c3-4e55-5ce3-b541-38421353307f with identifier: SA26868
2025-12-05 20:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40c2f9c3-4e55-5ce3-b541-38421353307f with identifier: SA26868
2025-12-05 20:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40c2f9c3-4e55-5ce3-b541-38421353307f with identifier: SA26868 to the API
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_2c543f5d3e197f7df52d31054e60138d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 87,
 'expiration_date': '2025-12-06T16:33:28Z',
 'fuel_type': 'petrol',
 'id': '40c2f9c3-4e55-5ce3-b541-38421353307f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA26868',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Mahindra',
 'model': 'KUV 100',
 'odometer': 18465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3b3afa9ca11048504983bddc2d271912.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2649032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_a19d1b6e3e39895a5e8a79d2f659ecce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_17661428c4426e48c70e2741a344ddea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530534,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_2c543f5d3e197f7df52d31054e60138d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593905,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_48b9b0f41e5596c889cc178b616067dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8f52677b07a9d0ce824ea29198b2a889.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d81c04f1bfd1cc7ad5a7463582c6c4e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611202,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ba3f1e9da9d55ec892d9ca7249e596df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_d09e5a032b0ea6979431be744919ab4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2696479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_4f92f0d60196994e5b96bd86b0b4e912.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_fc9e31a599f7e1346db9f2c45fb48e7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_8e910f870416ea004b6565a74bcd4d86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_3207218aef0b244bb8fe8e5cb40da8ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2709611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_5942b161919e3a7f7bf30d0bfe77a7b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c2f9c3-4e55-5ce3-b541-38421353307f/40c2f9c3-4e55-5ce3-b541-38421353307f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a7b4a7cb70c1e1471236c887a5294/pa/SA26868_ef7e63ba16cacd06b26b3cc75d4df29e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mahindra KUV 100 1.2 K6+',
 'transmission': 'manual',
 'trim': 'K6+',
 'year': 2023}
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA26868%27 HTTP/1.1" 200 None
2025-12-05 20:04:49 [auto1.it] INFO: Saving data for SA26868: {'created_time': 1764965089.446532, 'last_price_update_time': 1764965089.446541, 'auction_closing_time': 1765038808.0}
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SA26868') HTTP/1.1" 204 0
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37165d0>
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_2bef3957c92570bf17dd812b76c91da9.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2bef3957c92570bf17dd812b76c91da9.jpg saved to cache
2025-12-05 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9c03d1f8b7915b3c96e172f459dd5dff.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN37442> (referer: https://www.auto1.com/v1/car-details-view/DN37442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL08062/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA93014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05b6d10>
2025-12-05 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F3d%252F733d41ad200ab29d1d4a972ba40c08ee%252Fpa%252FJP94676_118851312a37f5b101ef5b9b5492bf57.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_118851312a37f5b101ef5b9b5492bf57.jpg saved to cache
2025-12-05 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c515c25-4781-50dc-a3ea-eba671a79759
2025-12-05 20:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c515c25-4781-50dc-a3ea-eba671a79759, skipping ID generation
2025-12-05 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c515c25-4781-50dc-a3ea-eba671a79759 with scrape type 1
2025-12-05 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6c515c25-4781-50dc-a3ea-eba671a79759 from tracking dictionaries
2025-12-05 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c515c25-4781-50dc-a3ea-eba671a79759 sending to next pipeline
2025-12-05 20:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c515c25-4781-50dc-a3ea-eba671a79759, identifier: JP94676
2025-12-05 20:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385
2025-12-05 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5047b41-8d91-5f22-9388-a0f0732cf675 with scrape type 1
2025-12-05 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_6d8b4628d6f915722122d6b18e2574a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6d8b4628d6f915722122d6b18e2574a9.jpg not downloaded yet
2025-12-05 20:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c515c25-4781-50dc-a3ea-eba671a79759 with identifier: JP94676
2025-12-05 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c515c25-4781-50dc-a3ea-eba671a79759 with identifier: JP94676
2025-12-05 20:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c515c25-4781-50dc-a3ea-eba671a79759 with identifier: JP94676 to the API
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_118851312a37f5b101ef5b9b5492bf57.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:00:24Z',
 'fuel_type': 'petrol',
 'id': '6c515c25-4781-50dc-a3ea-eba671a79759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP94676',
 'listing': 'auction',
 'location': 'IT, Marino',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 58829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3077327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_539c9ce4fc5f72c28924bab4034c8a87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_9b08e1d75be18cfb8963545938d9cf60.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_20725cb4449c71de8f772a8df6a912c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b69695c96fdb917b1db402686cc3feb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3150983,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_118851312a37f5b101ef5b9b5492bf57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_907fed43a4c9961fd3898d39566a4e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_b3d75a5d7cb87df2e10282839fc126c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_756f67bf130775fdd949ddd915c48436.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_7dbf9fdf768c85945757fa1ad7f9fe94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3130598,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_2805284c8d2e40f267dd3a6c2c70421f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_76923695062454b577c7f9d5f1e52932.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_61b651fbde18663e95cb6b15220bbd3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_dd04163ac73f1d8f773e922ea4439a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2443185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_720212d7a756a4666787a922b343cddb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c515c25-4781-50dc-a3ea-eba671a79759/6c515c25-4781-50dc-a3ea-eba671a79759_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/3d/733d41ad200ab29d1d4a972ba40c08ee/pa/JP94676_5b8d4d5b9113fc502448f19a6e63e313.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 TGDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP94676%27 HTTP/1.1" 200 None
2025-12-05 20:04:50 [auto1.it] INFO: Saving data for JP94676: {'created_time': 1764965090.652318, 'last_price_update_time': 1764965090.652332, 'auction_closing_time': 1765036824.0}
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP94676') HTTP/1.1" 204 0
2025-12-05 20:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0023e7b952b6d6ebe7ee9e318558c62c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2927594d54542cbd68b3008f074eb15.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_6ff922162598f931cc69d2c9b5a196dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6ff922162598f931cc69d2c9b5a196dc.jpg not downloaded yet
2025-12-05 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0424990>
2025-12-05 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_9c03d1f8b7915b3c96e172f459dd5dff.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9c03d1f8b7915b3c96e172f459dd5dff.jpg saved to cache
2025-12-05 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f71f878-fe2d-517f-8e83-22584ec6a9c0 with identifier: DN37442
2025-12-05 20:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f71f878-fe2d-517f-8e83-22584ec6a9c0 with scrape type 2
2025-12-05 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f71f878-fe2d-517f-8e83-22584ec6a9c0 with scrape type 2
2025-12-05 20:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f71f878-fe2d-517f-8e83-22584ec6a9c0, identifier: DN37442
2025-12-05 20:04:51 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_202a0512f064b9955b8830533cd9dd41.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_202a0512f064b9955b8830533cd9dd41.jpg not downloaded yet
2025-12-05 20:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f71f878-fe2d-517f-8e83-22584ec6a9c0 with identifier: DN37442
2025-12-05 20:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f71f878-fe2d-517f-8e83-22584ec6a9c0 with identifier: DN37442
2025-12-05 20:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f71f878-fe2d-517f-8e83-22584ec6a9c0 with identifier: DN37442 to the API
2025-12-05 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN37442>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2025-12-06T16:37:28Z',
 'fuel_type': 'hybrid',
 'id': '8f71f878-fe2d-517f-8e83-22584ec6a9c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN37442',
 'listing': 'auction',
 'location': 'IT',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 134247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN37442%27 HTTP/1.1" 200 None
2025-12-05 20:04:52 [auto1.it] INFO: Saving data for DN37442: {'auction_closing_time': 1765039048.0, 'created_time': 1764619475.439886, 'last_price_update_time': 1764965092.066249}
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DN37442') HTTP/1.1" 204 0
2025-12-05 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9fa658ab81904f2de0716f6adbedd2b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0e4d5c6807adebee425825db67b6ca6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_b72218345582e0aed38fcbaef2add5cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_b72218345582e0aed38fcbaef2add5cf.jpg not downloaded yet
2025-12-05 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL99717> (referer: https://www.auto1.com/v1/car-details-view/EL99717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY92784> (referer: https://www.auto1.com/v1/car-details-view/TY92784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD15541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6d8b4628d6f915722122d6b18e2574a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_331ab985bfc2d2e68e3f428c04f7003c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_331ab985bfc2d2e68e3f428c04f7003c.jpg not downloaded yet
2025-12-05 20:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e4350>
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_0023e7b952b6d6ebe7ee9e318558c62c.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0023e7b952b6d6ebe7ee9e318558c62c.jpg saved to cache
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00e1710>
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_a2927594d54542cbd68b3008f074eb15.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2927594d54542cbd68b3008f074eb15.jpg saved to cache
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_d062a564b9c4cd176f67ee3dc460d291.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_5ea365d92d9025e378397e6065f5873f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_5ea365d92d9025e378397e6065f5873f.jpg not downloaded yet
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05d8950>
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_9fa658ab81904f2de0716f6adbedd2b1.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9fa658ab81904f2de0716f6adbedd2b1.jpg saved to cache
2025-12-05 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014e690>
2025-12-05 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_0e4d5c6807adebee425825db67b6ca6e.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0e4d5c6807adebee425825db67b6ca6e.jpg saved to cache
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5841d931-0b82-5afd-ba21-a4fbdcda6616 with identifier: EL99717
2025-12-05 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5841d931-0b82-5afd-ba21-a4fbdcda6616 with scrape type 2
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5841d931-0b82-5afd-ba21-a4fbdcda6616 with scrape type 2
2025-12-05 20:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5841d931-0b82-5afd-ba21-a4fbdcda6616, identifier: EL99717
2025-12-05 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78aa7056-e7b5-5700-bcd6-aab48e2e64f7 with identifier: TY92784
2025-12-05 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78aa7056-e7b5-5700-bcd6-aab48e2e64f7 with scrape type 1
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 78aa7056-e7b5-5700-bcd6-aab48e2e64f7
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_1f7b037ba5e12c1b361767af59622b2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_1f7b037ba5e12c1b361767af59622b2a.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_ccd131bb439f9f2fbdffdfe23c5afa19.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_ccd131bb439f9f2fbdffdfe23c5afa19.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_9331bc956ab0a869a2da5a6230b77ba0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_9331bc956ab0a869a2da5a6230b77ba0.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_b03759871a3ef863f2f5a35a45e2fa95.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_b03759871a3ef863f2f5a35a45e2fa95.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_13c0b85da103777d74b71983773035ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_13c0b85da103777d74b71983773035ac.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_634896edb702173551f5ac00b67220cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_634896edb702173551f5ac00b67220cc.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_28163c8d908aab97ce66432e2a345196.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_28163c8d908aab97ce66432e2a345196.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_8eb6990915d06fc870f39efd6688dc8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_8eb6990915d06fc870f39efd6688dc8d.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_c80337f209b3fe24370d0b971bf5b401.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_c80337f209b3fe24370d0b971bf5b401.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_44c91f416faf52db37eea229a0b8151c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_44c91f416faf52db37eea229a0b8151c.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_d468e9d935dfa7793f28240439f3a289.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_d468e9d935dfa7793f28240439f3a289.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_16d64cd4e3701ac37ba1052410565656.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_16d64cd4e3701ac37ba1052410565656.jpg already downloaded
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fb8%252Ff1b80a3aefab875fb4e09baa9338c8ea%252Fpa%252FTY92784_c1551705c2f842beb6f405993a2e034c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_c1551705c2f842beb6f405993a2e034c.jpg already downloaded
2025-12-05 20:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 78aa7056-e7b5-5700-bcd6-aab48e2e64f7, identifier: TY92784
2025-12-05 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03969d0>
2025-12-05 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_6d8b4628d6f915722122d6b18e2574a9.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6d8b4628d6f915722122d6b18e2574a9.jpg saved to cache
2025-12-05 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_597be23609e7b97312e215bd16baa240.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_597be23609e7b97312e215bd16baa240.jpg not downloaded yet
2025-12-05 20:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5841d931-0b82-5afd-ba21-a4fbdcda6616 with identifier: EL99717
2025-12-05 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5841d931-0b82-5afd-ba21-a4fbdcda6616 with identifier: EL99717
2025-12-05 20:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5841d931-0b82-5afd-ba21-a4fbdcda6616 with identifier: EL99717 to the API
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL99717>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2025-12-06T16:18:42Z',
 'fuel_type': 'hybrid',
 'id': '5841d931-0b82-5afd-ba21-a4fbdcda6616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL99717',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 62032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL99717%27 HTTP/1.1" 200 None
2025-12-05 20:04:54 [auto1.it] INFO: Saving data for EL99717: {'auction_closing_time': 1765037922.0, 'created_time': 1760731489.040338, 'last_price_update_time': 1764965094.433148}
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EL99717') HTTP/1.1" 204 0
2025-12-05 20:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 78aa7056-e7b5-5700-bcd6-aab48e2e64f7 with identifier: TY92784
2025-12-05 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 78aa7056-e7b5-5700-bcd6-aab48e2e64f7 with identifier: TY92784
2025-12-05 20:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 78aa7056-e7b5-5700-bcd6-aab48e2e64f7 with identifier: TY92784 to the API
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY92784>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-06T16:07:09Z',
 'fuel_type': 'diesel',
 'id': '78aa7056-e7b5-5700-bcd6-aab48e2e64f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY92784',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 96164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_1f7b037ba5e12c1b361767af59622b2a.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_ccd131bb439f9f2fbdffdfe23c5afa19.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_9331bc956ab0a869a2da5a6230b77ba0.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_b03759871a3ef863f2f5a35a45e2fa95.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_13c0b85da103777d74b71983773035ac.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_634896edb702173551f5ac00b67220cc.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_28163c8d908aab97ce66432e2a345196.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_8eb6990915d06fc870f39efd6688dc8d.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_c80337f209b3fe24370d0b971bf5b401.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_44c91f416faf52db37eea229a0b8151c.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_d468e9d935dfa7793f28240439f3a289.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_16d64cd4e3701ac37ba1052410565656.jpg',
                'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_c1551705c2f842beb6f405993a2e034c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_1f7b037ba5e12c1b361767af59622b2a.jpg',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_ccd131bb439f9f2fbdffdfe23c5afa19.jpg',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73881,
             'Height': 527,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_9331bc956ab0a869a2da5a6230b77ba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_b03759871a3ef863f2f5a35a45e2fa95.jpg',
             'Width': 740},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_13c0b85da103777d74b71983773035ac.jpg',
             'Width': 795},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85027,
             'Height': 551,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_634896edb702173551f5ac00b67220cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_28163c8d908aab97ce66432e2a345196.jpg',
             'Width': 650},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_8eb6990915d06fc870f39efd6688dc8d.jpg',
             'Width': 650},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_c80337f209b3fe24370d0b971bf5b401.jpg',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_44c91f416faf52db37eea229a0b8151c.jpg',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_d468e9d935dfa7793f28240439f3a289.jpg',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_16d64cd4e3701ac37ba1052410565656.jpg',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78aa7056-e7b5-5700-bcd6-aab48e2e64f7/78aa7056-e7b5-5700-bcd6-aab48e2e64f7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/b8/f1b80a3aefab875fb4e09baa9338c8ea/pa/TY92784_c1551705c2f842beb6f405993a2e034c.jpg',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY92784%27 HTTP/1.1" 200 None
2025-12-05 20:04:54 [auto1.it] INFO: Saving data for TY92784: {'created_time': 1764965094.832113, 'last_price_update_time': 1764965094.832123, 'auction_closing_time': 1765037229.0}
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TY92784') HTTP/1.1" 204 0
2025-12-05 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_202a0512f064b9955b8830533cd9dd41.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_b72218345582e0aed38fcbaef2add5cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_9840038f3fff5c8a47e5a146222faf47.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_9840038f3fff5c8a47e5a146222faf47.jpg not downloaded yet
2025-12-05 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA46631> (referer: https://www.auto1.com/v1/car-details-view/LA46631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB16740> (referer: https://www.auto1.com/v1/car-details-view/JB16740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ96401> (referer: https://www.auto1.com/v1/car-details-view/PJ96401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ70755> (referer: https://www.auto1.com/v1/car-details-view/MJ70755/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0261610>
2025-12-05 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_d062a564b9c4cd176f67ee3dc460d291.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_d062a564b9c4cd176f67ee3dc460d291.jpg saved to cache
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6ff922162598f931cc69d2c9b5a196dc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_bce9d15da7fe79c4876489b6ee785523.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bce9d15da7fe79c4876489b6ee785523.jpg not downloaded yet
2025-12-05 20:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_8a170d8cfeece43451fef03a0f059087.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8a170d8cfeece43451fef03a0f059087.jpg not downloaded yet
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae032b150>
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_202a0512f064b9955b8830533cd9dd41.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_202a0512f064b9955b8830533cd9dd41.jpg saved to cache
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae044b690>
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_b72218345582e0aed38fcbaef2add5cf.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_b72218345582e0aed38fcbaef2add5cf.jpg saved to cache
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af7ac050-34ce-5f9e-a7d6-dbaa91687267 with identifier: LA46631
2025-12-05 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af7ac050-34ce-5f9e-a7d6-dbaa91687267 with scrape type 2
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af7ac050-34ce-5f9e-a7d6-dbaa91687267 with scrape type 2
2025-12-05 20:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af7ac050-34ce-5f9e-a7d6-dbaa91687267, identifier: LA46631
2025-12-05 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cfad6e8-f064-5538-9ec5-8fd9b14071f1 with identifier: JB16740
2025-12-05 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfad6e8-f064-5538-9ec5-8fd9b14071f1 with scrape type 1
2025-12-05 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3cfad6e8-f064-5538-9ec5-8fd9b14071f1
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_391f2a8472d2b4039fe0be80ab1d82cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_391f2a8472d2b4039fe0be80ab1d82cb.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_30731cf3b027dd435809627be827c994.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_30731cf3b027dd435809627be827c994.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_6159f25f7fe26bdc6a32936199eea367.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_6159f25f7fe26bdc6a32936199eea367.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_294d95ff7126630cf992dc83f7f7bb92.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_294d95ff7126630cf992dc83f7f7bb92.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_b4267d71e57ed0869313929f917ab146.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b4267d71e57ed0869313929f917ab146.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_0fd7e4574016e7f04b53fa07ac4d65f5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_0fd7e4574016e7f04b53fa07ac4d65f5.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_b1e9ac90f886cbc78e5ee5d8f4fc8b8a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b1e9ac90f886cbc78e5ee5d8f4fc8b8a.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_4334dfd50ce5bad016f676cf2be4f841.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_4334dfd50ce5bad016f676cf2be4f841.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_aac8badc058b834e7df0c400b3ec5cb7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_aac8badc058b834e7df0c400b3ec5cb7.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_3a556a2ab8ec2208de87bcebbe9b40bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_3a556a2ab8ec2208de87bcebbe9b40bb.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_b1addbd22449f754b601345d525024e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b1addbd22449f754b601345d525024e7.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_a99d47c26656121ae99bd944b4e61296.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_a99d47c26656121ae99bd944b4e61296.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_92581f2cd88d1da63fa290486aa57457.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_92581f2cd88d1da63fa290486aa57457.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_60307c81f8c7e6b707a181bc550eec46.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_60307c81f8c7e6b707a181bc550eec46.jpg already downloaded
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F47%252Fdf471e6dfb22f22afe83e962d240af1e%252Fpa%252FJB16740_9200113a1d1932bbd5ce579a63e9a0d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_9200113a1d1932bbd5ce579a63e9a0d4.jpg already downloaded
2025-12-05 20:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3cfad6e8-f064-5538-9ec5-8fd9b14071f1, identifier: JB16740
2025-12-05 20:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ba0873-c6e5-5b95-a5a6-2559bf8bf603 with identifier: PJ96401
2025-12-05 20:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ba0873-c6e5-5b95-a5a6-2559bf8bf603 with scrape type 2
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11ba0873-c6e5-5b95-a5a6-2559bf8bf603 with scrape type 2
2025-12-05 20:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 11ba0873-c6e5-5b95-a5a6-2559bf8bf603, identifier: PJ96401
2025-12-05 20:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01955256-33f6-5ec7-8f47-9005beb661a5 with identifier: MJ70755
2025-12-05 20:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01955256-33f6-5ec7-8f47-9005beb661a5 with scrape type 1
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_830c36ddc312f73d5387ed4420445be9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_830c36ddc312f73d5387ed4420445be9.jpg not downloaded yet
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_bc9f6bc0d3baa1cf1bba5ef56fe4d55d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bc9f6bc0d3baa1cf1bba5ef56fe4d55d.jpg not downloaded yet
2025-12-05 20:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af7ac050-34ce-5f9e-a7d6-dbaa91687267 with identifier: LA46631
2025-12-05 20:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af7ac050-34ce-5f9e-a7d6-dbaa91687267 with identifier: LA46631
2025-12-05 20:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af7ac050-34ce-5f9e-a7d6-dbaa91687267 with identifier: LA46631 to the API
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA46631>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2025-12-06T16:58:24Z',
 'fuel_type': 'petrol',
 'id': 'af7ac050-34ce-5f9e-a7d6-dbaa91687267',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA46631',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 95358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA46631%27 HTTP/1.1" 200 None
2025-12-05 20:04:56 [auto1.it] INFO: Saving data for LA46631: {'auction_closing_time': 1765040304.0, 'created_time': 1762286499.014327, 'last_price_update_time': 1764965096.942241}
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA46631') HTTP/1.1" 204 0
2025-12-05 20:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3cfad6e8-f064-5538-9ec5-8fd9b14071f1 with identifier: JB16740
2025-12-05 20:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3cfad6e8-f064-5538-9ec5-8fd9b14071f1 with identifier: JB16740
2025-12-05 20:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3cfad6e8-f064-5538-9ec5-8fd9b14071f1 with identifier: JB16740 to the API
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB16740>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:16:40Z',
 'fuel_type': 'hybrid',
 'id': '3cfad6e8-f064-5538-9ec5-8fd9b14071f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB16740',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 38641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_391f2a8472d2b4039fe0be80ab1d82cb.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_30731cf3b027dd435809627be827c994.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_6159f25f7fe26bdc6a32936199eea367.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_294d95ff7126630cf992dc83f7f7bb92.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b4267d71e57ed0869313929f917ab146.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_0fd7e4574016e7f04b53fa07ac4d65f5.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b1e9ac90f886cbc78e5ee5d8f4fc8b8a.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_4334dfd50ce5bad016f676cf2be4f841.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_aac8badc058b834e7df0c400b3ec5cb7.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_3a556a2ab8ec2208de87bcebbe9b40bb.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b1addbd22449f754b601345d525024e7.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_a99d47c26656121ae99bd944b4e61296.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_92581f2cd88d1da63fa290486aa57457.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_60307c81f8c7e6b707a181bc550eec46.jpg',
                'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_9200113a1d1932bbd5ce579a63e9a0d4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_391f2a8472d2b4039fe0be80ab1d82cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_30731cf3b027dd435809627be827c994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_6159f25f7fe26bdc6a32936199eea367.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_294d95ff7126630cf992dc83f7f7bb92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b4267d71e57ed0869313929f917ab146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_0fd7e4574016e7f04b53fa07ac4d65f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b1e9ac90f886cbc78e5ee5d8f4fc8b8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_4334dfd50ce5bad016f676cf2be4f841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_aac8badc058b834e7df0c400b3ec5cb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_3a556a2ab8ec2208de87bcebbe9b40bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_b1addbd22449f754b601345d525024e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_a99d47c26656121ae99bd944b4e61296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_92581f2cd88d1da63fa290486aa57457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_60307c81f8c7e6b707a181bc550eec46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cfad6e8-f064-5538-9ec5-8fd9b14071f1/3cfad6e8-f064-5538-9ec5-8fd9b14071f1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/47/df471e6dfb22f22afe83e962d240af1e/pa/JB16740_9200113a1d1932bbd5ce579a63e9a0d4.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active',
 'transmission': 'automatic',
 'trim': '2WD Active',
 'year': 2023}
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB16740%27 HTTP/1.1" 200 None
2025-12-05 20:04:57 [auto1.it] INFO: Saving data for JB16740: {'created_time': 1764965097.274655, 'last_price_update_time': 1764965097.274667, 'auction_closing_time': 1765037800.0}
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB16740') HTTP/1.1" 204 0
2025-12-05 20:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 11ba0873-c6e5-5b95-a5a6-2559bf8bf603 with identifier: PJ96401
2025-12-05 20:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 11ba0873-c6e5-5b95-a5a6-2559bf8bf603 with identifier: PJ96401
2025-12-05 20:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 11ba0873-c6e5-5b95-a5a6-2559bf8bf603 with identifier: PJ96401 to the API
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PJ96401>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 129,
 'expiration_date': '2025-12-06T16:09:15Z',
 'fuel_type': 'petrol',
 'id': '11ba0873-c6e5-5b95-a5a6-2559bf8bf603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ96401',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 32553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 DITC Mild-Hybrid 4x2 Top',
 'transmission': 'manual',
 'trim': '4x2 Top',
 'year': 2020}
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ96401%27 HTTP/1.1" 200 None
2025-12-05 20:04:57 [auto1.it] INFO: Saving data for PJ96401: {'auction_closing_time': 1765037355.0, 'created_time': 1764619553.930731, 'last_price_update_time': 1764965097.693281}
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PJ96401') HTTP/1.1" 204 0
2025-12-05 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_5ea365d92d9025e378397e6065f5873f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_9840038f3fff5c8a47e5a146222faf47.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_03cb7df2eaac8d3e70289bbb415322d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_03cb7df2eaac8d3e70289bbb415322d9.jpg not downloaded yet
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_eb92f0321c41a655ebb4fe5f417b735a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_eb92f0321c41a655ebb4fe5f417b735a.jpg not downloaded yet
2025-12-05 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP46319> (referer: https://www.auto1.com/v1/car-details-view/VP46319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL08062> (referer: https://www.auto1.com/v1/car-details-view/BL08062/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA93014> (referer: https://www.auto1.com/v1/car-details-view/JA93014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP67985> (referer: https://www.auto1.com/v1/car-details-view/UP67985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_f907c42de9003fb3dc3d3a6108f70c67.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_f907c42de9003fb3dc3d3a6108f70c67.jpg not downloaded yet
2025-12-05 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_597be23609e7b97312e215bd16baa240.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_98d335e1b01379a2ef0ca467bb2f13e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_98d335e1b01379a2ef0ca467bb2f13e6.jpg not downloaded yet
2025-12-05 20:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae024c050>
2025-12-05 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_6ff922162598f931cc69d2c9b5a196dc.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6ff922162598f931cc69d2c9b5a196dc.jpg saved to cache
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_36c45708c4512a4ee619dd9d8d797d24.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_36c45708c4512a4ee619dd9d8d797d24.jpg not downloaded yet
2025-12-05 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_331ab985bfc2d2e68e3f428c04f7003c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_b5f07a46c4a1eeda1361112b2b074ee1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_ef2c48bf20f15e287f3f8a8a13e5dd78.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_ef2c48bf20f15e287f3f8a8a13e5dd78.jpg not downloaded yet
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_61f07448e47e38cb15a70b1902b1eb12.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_61f07448e47e38cb15a70b1902b1eb12.jpg not downloaded yet
2025-12-05 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_7c59fd190daf05b565e8d41bedc765e1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2078874e5685266d75d0afb7265443d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_830c36ddc312f73d5387ed4420445be9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_8d57075d70ebd81027cc356efd6cc701.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8d57075d70ebd81027cc356efd6cc701.jpg not downloaded yet
2025-12-05 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8a170d8cfeece43451fef03a0f059087.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_e129e226e4d75bca9f2741a3350e95d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_e129e226e4d75bca9f2741a3350e95d9.jpg not downloaded yet
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae006fad0>
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_5ea365d92d9025e378397e6065f5873f.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_5ea365d92d9025e378397e6065f5873f.jpg saved to cache
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad371fb10>
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_9840038f3fff5c8a47e5a146222faf47.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_9840038f3fff5c8a47e5a146222faf47.jpg saved to cache
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d with identifier: VP46319
2025-12-05 20:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d with scrape type 1
2025-12-05 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_55999978c3acb445bb06be51213c385b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_55999978c3acb445bb06be51213c385b.jpg not downloaded yet
2025-12-05 20:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 778da9b7-dfa5-5d6c-8be1-8ceb10e92810 with identifier: BL08062
2025-12-05 20:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 778da9b7-dfa5-5d6c-8be1-8ceb10e92810 with scrape type 2
2025-12-05 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 778da9b7-dfa5-5d6c-8be1-8ceb10e92810 with scrape type 2
2025-12-05 20:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 778da9b7-dfa5-5d6c-8be1-8ceb10e92810, identifier: BL08062
2025-12-05 20:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106dd54a-7d63-5717-b055-7b8b391aaa48 with identifier: JA93014
2025-12-05 20:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106dd54a-7d63-5717-b055-7b8b391aaa48 with scrape type 2
2025-12-05 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 106dd54a-7d63-5717-b055-7b8b391aaa48 with scrape type 2
2025-12-05 20:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 106dd54a-7d63-5717-b055-7b8b391aaa48, identifier: JA93014
2025-12-05 20:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1fa4de9-6fb0-5446-a2be-f61bd47d4dba with identifier: UP67985
2025-12-05 20:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1fa4de9-6fb0-5446-a2be-f61bd47d4dba with scrape type 2
2025-12-05 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1fa4de9-6fb0-5446-a2be-f61bd47d4dba with scrape type 2
2025-12-05 20:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1fa4de9-6fb0-5446-a2be-f61bd47d4dba, identifier: UP67985
2025-12-05 20:04:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad364a690>
2025-12-05 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_597be23609e7b97312e215bd16baa240.jpg') HTTP/1.1" 204 0
2025-12-05 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_597be23609e7b97312e215bd16baa240.jpg saved to cache
2025-12-05 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_eb92f0321c41a655ebb4fe5f417b735a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 778da9b7-dfa5-5d6c-8be1-8ceb10e92810 with identifier: BL08062
2025-12-05 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 778da9b7-dfa5-5d6c-8be1-8ceb10e92810 with identifier: BL08062
2025-12-05 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
2025-12-05 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 778da9b7-dfa5-5d6c-8be1-8ceb10e92810 spider: auto1.it
2025-12-05 20:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 778da9b7-dfa5-5d6c-8be1-8ceb10e92810 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:00:59Z',
 'fuel_type': 'diesel',
 'id': '778da9b7-dfa5-5d6c-8be1-8ceb10e92810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL08062',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 80375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean FWD',
 'transmission': 'automatic',
 'trim': 'Ocean FWD',
 'year': 2022}
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL08062%27 HTTP/1.1" 200 None
2025-12-05 20:04:59 [auto1.it] INFO: Saving data for BL08062: {'auction_closing_time': 1765036859.0, 'created_time': 1764619613.66636, 'last_price_update_time': 1764965099.902983}
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL08062') HTTP/1.1" 204 0
2025-12-05 20:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 106dd54a-7d63-5717-b055-7b8b391aaa48 with identifier: JA93014
2025-12-05 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 106dd54a-7d63-5717-b055-7b8b391aaa48 with identifier: JA93014
2025-12-05 20:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 106dd54a-7d63-5717-b055-7b8b391aaa48 with identifier: JA93014 to the API
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JA93014>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 211,
 'expiration_date': '2025-12-06T16:44:09Z',
 'fuel_type': 'diesel',
 'id': '106dd54a-7d63-5717-b055-7b8b391aaa48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA93014',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 143588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2020}
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA93014%27 HTTP/1.1" 200 None
2025-12-05 20:05:00 [auto1.it] INFO: Saving data for JA93014: {'auction_closing_time': 1765039449.0, 'created_time': 1762286652.255814, 'last_price_update_time': 1764965100.280263}
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JA93014') HTTP/1.1" 204 0
2025-12-05 20:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1fa4de9-6fb0-5446-a2be-f61bd47d4dba with identifier: UP67985
2025-12-05 20:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1fa4de9-6fb0-5446-a2be-f61bd47d4dba with identifier: UP67985
2025-12-05 20:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1fa4de9-6fb0-5446-a2be-f61bd47d4dba with identifier: UP67985 to the API
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UP67985>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2025-12-06T16:12:34Z',
 'fuel_type': 'diesel',
 'id': 'f1fa4de9-6fb0-5446-a2be-f61bd47d4dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP67985',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 78533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi Energy Initiale Paris 4x4',
 'transmission': 'automatic',
 'trim': 'Initiale Paris 4x4',
 'year': 2017}
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP67985%27 HTTP/1.1" 200 None
2025-12-05 20:05:00 [auto1.it] INFO: Saving data for UP67985: {'auction_closing_time': 1765037554.0, 'created_time': 1762373058.320676, 'last_price_update_time': 1764965100.638535}
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UP67985') HTTP/1.1" 204 0
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_457a011b9cbd565634aa859c910193ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_457a011b9cbd565634aa859c910193ca.jpg not downloaded yet
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_b09ff979107bada3d99736cc96b7e364.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_b09ff979107bada3d99736cc96b7e364.jpg not downloaded yet
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b4890>
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_331ab985bfc2d2e68e3f428c04f7003c.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_331ab985bfc2d2e68e3f428c04f7003c.jpg saved to cache
2025-12-05 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0171050>
2025-12-05 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_b5f07a46c4a1eeda1361112b2b074ee1.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_b5f07a46c4a1eeda1361112b2b074ee1.jpg saved to cache
2025-12-05 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD15541> (referer: https://www.auto1.com/v1/car-details-view/TD15541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_03cb7df2eaac8d3e70289bbb415322d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_98d335e1b01379a2ef0ca467bb2f13e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_04128650930de0fc3b8e9869f1c6485c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_04128650930de0fc3b8e9869f1c6485c.jpg not downloaded yet
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_54ffb6f134e046f2af2c4cbef9f51142.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_54ffb6f134e046f2af2c4cbef9f51142.jpg not downloaded yet
2025-12-05 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW70541> (referer: https://www.auto1.com/v1/car-details-view/PW70541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03fbd90>
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_7c59fd190daf05b565e8d41bedc765e1.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_7c59fd190daf05b565e8d41bedc765e1.jpg saved to cache
2025-12-05 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae033f650>
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_a2078874e5685266d75d0afb7265443d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2078874e5685266d75d0afb7265443d.jpg saved to cache
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a7810>
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_830c36ddc312f73d5387ed4420445be9.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_830c36ddc312f73d5387ed4420445be9.jpg saved to cache
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05f6f50>
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_8a170d8cfeece43451fef03a0f059087.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8a170d8cfeece43451fef03a0f059087.jpg saved to cache
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05e7a10>
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_eb92f0321c41a655ebb4fe5f417b735a.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_eb92f0321c41a655ebb4fe5f417b735a.jpg saved to cache
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_c313e2aee5d1f34e9bac2668c1a50fda.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_b855b495cd541a00f2c8910176fb9137.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_b855b495cd541a00f2c8910176fb9137.jpg not downloaded yet
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_0c7dabbb9c8f6596968d450a74cbc09b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_0c7dabbb9c8f6596968d450a74cbc09b.jpg not downloaded yet
2025-12-05 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bce9d15da7fe79c4876489b6ee785523.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bc9f6bc0d3baa1cf1bba5ef56fe4d55d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_f907c42de9003fb3dc3d3a6108f70c67.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799ba2e2-482c-575b-8eb6-c2ed61be760c with identifier: TD15541
2025-12-05 20:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799ba2e2-482c-575b-8eb6-c2ed61be760c with scrape type 2
2025-12-05 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 799ba2e2-482c-575b-8eb6-c2ed61be760c with scrape type 2
2025-12-05 20:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 799ba2e2-482c-575b-8eb6-c2ed61be760c, identifier: TD15541
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae047a190>
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_03cb7df2eaac8d3e70289bbb415322d9.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_03cb7df2eaac8d3e70289bbb415322d9.jpg saved to cache
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3726bd0>
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_98d335e1b01379a2ef0ca467bb2f13e6.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_98d335e1b01379a2ef0ca467bb2f13e6.jpg saved to cache
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70218ff4-0a42-509f-90b4-1824a834433a with identifier: PW70541
2025-12-05 20:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70218ff4-0a42-509f-90b4-1824a834433a with scrape type 1
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 70218ff4-0a42-509f-90b4-1824a834433a
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_a9c5a13b2dcd5dd72c462d0ba4a0371e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_a9c5a13b2dcd5dd72c462d0ba4a0371e.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_cf72dbe394edb0f46b631e2bc13a7fdc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_cf72dbe394edb0f46b631e2bc13a7fdc.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_d3d443c7efabb0707a5d853e96650722.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_d3d443c7efabb0707a5d853e96650722.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_befc8d7a644b0752efdc5e6719ff847a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_befc8d7a644b0752efdc5e6719ff847a.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_c751d87c8565c396368be4c7c9913335.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_c751d87c8565c396368be4c7c9913335.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_3cfc947262aa0fe52076c4e79efe4ffe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_3cfc947262aa0fe52076c4e79efe4ffe.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_8529a75682ad864085bab2f03445d1f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_8529a75682ad864085bab2f03445d1f8.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_faf60e16ba50cea67891651d663eb777.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_faf60e16ba50cea67891651d663eb777.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_77490bb4171689dc9033bdab4315e54e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_77490bb4171689dc9033bdab4315e54e.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_c31e292bc9fbbb7ea920fcc609f31546.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_c31e292bc9fbbb7ea920fcc609f31546.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_923d784b0e2a0724068847ccc3cf8401.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_923d784b0e2a0724068847ccc3cf8401.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_d854300ef68a8bd6f9c46425eb9649fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_d854300ef68a8bd6f9c46425eb9649fa.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_1ab5004425f45ba9a68b34f35bf82d2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_1ab5004425f45ba9a68b34f35bf82d2a.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_e2fa0d4ea77b4d89dcddd8dd7e207cdc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_e2fa0d4ea77b4d89dcddd8dd7e207cdc.jpg already downloaded
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8d%252F0e8d9f724477da524ba7db85368312b5%252Fpa%252FPW70541_b646f2ecff2f3439e0369873136c6b18.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_b646f2ecff2f3439e0369873136c6b18.jpg already downloaded
2025-12-05 20:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 70218ff4-0a42-509f-90b4-1824a834433a, identifier: PW70541
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_731fdb120421c241905efb185a6bea61.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_731fdb120421c241905efb185a6bea61.jpg not downloaded yet
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_685df93e1f2db5eb481c329d96038d0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_685df93e1f2db5eb481c329d96038d0b.jpg not downloaded yet
2025-12-05 20:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 799ba2e2-482c-575b-8eb6-c2ed61be760c with identifier: TD15541
2025-12-05 20:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 799ba2e2-482c-575b-8eb6-c2ed61be760c with identifier: TD15541
2025-12-05 20:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2025-12-05 20:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 799ba2e2-482c-575b-8eb6-c2ed61be760c spider: auto1.it
2025-12-05 20:05:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 799ba2e2-482c-575b-8eb6-c2ed61be760c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:44:13Z',
 'fuel_type': 'diesel',
 'id': '799ba2e2-482c-575b-8eb6-c2ed61be760c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD15541',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 93337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet 33 L3H2 Hochdach verblecht',
 'transmission': 'manual',
 'trim': '33 L3H2 Hochdach verblecht',
 'year': 2023}
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD15541%27 HTTP/1.1" 200 None
2025-12-05 20:05:04 [auto1.it] INFO: Saving data for TD15541: {'auction_closing_time': 1765039453.0, 'created_time': 1764619621.578606, 'last_price_update_time': 1764965104.298835}
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD15541') HTTP/1.1" 204 0
2025-12-05 20:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 70218ff4-0a42-509f-90b4-1824a834433a with identifier: PW70541
2025-12-05 20:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 70218ff4-0a42-509f-90b4-1824a834433a with identifier: PW70541
2025-12-05 20:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 70218ff4-0a42-509f-90b4-1824a834433a with identifier: PW70541 to the API
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PW70541>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-06T16:36:47Z',
 'fuel_type': 'petrol',
 'id': '70218ff4-0a42-509f-90b4-1824a834433a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW70541',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 34084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_a9c5a13b2dcd5dd72c462d0ba4a0371e.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_cf72dbe394edb0f46b631e2bc13a7fdc.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_d3d443c7efabb0707a5d853e96650722.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_befc8d7a644b0752efdc5e6719ff847a.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_c751d87c8565c396368be4c7c9913335.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_3cfc947262aa0fe52076c4e79efe4ffe.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_8529a75682ad864085bab2f03445d1f8.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_faf60e16ba50cea67891651d663eb777.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_77490bb4171689dc9033bdab4315e54e.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_c31e292bc9fbbb7ea920fcc609f31546.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_923d784b0e2a0724068847ccc3cf8401.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_d854300ef68a8bd6f9c46425eb9649fa.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_1ab5004425f45ba9a68b34f35bf82d2a.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_e2fa0d4ea77b4d89dcddd8dd7e207cdc.jpg',
                'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_b646f2ecff2f3439e0369873136c6b18.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_a9c5a13b2dcd5dd72c462d0ba4a0371e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492097,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_cf72dbe394edb0f46b631e2bc13a7fdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_d3d443c7efabb0707a5d853e96650722.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_befc8d7a644b0752efdc5e6719ff847a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_c751d87c8565c396368be4c7c9913335.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_3cfc947262aa0fe52076c4e79efe4ffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_8529a75682ad864085bab2f03445d1f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_faf60e16ba50cea67891651d663eb777.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_77490bb4171689dc9033bdab4315e54e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2812649,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_c31e292bc9fbbb7ea920fcc609f31546.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2846394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_923d784b0e2a0724068847ccc3cf8401.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3109769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_d854300ef68a8bd6f9c46425eb9649fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_1ab5004425f45ba9a68b34f35bf82d2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_e2fa0d4ea77b4d89dcddd8dd7e207cdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70218ff4-0a42-509f-90b4-1824a834433a/70218ff4-0a42-509f-90b4-1824a834433a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8d/0e8d9f724477da524ba7db85368312b5/pa/PW70541_b646f2ecff2f3439e0369873136c6b18.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2017}
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70541%27 HTTP/1.1" 200 None
2025-12-05 20:05:04 [auto1.it] INFO: Saving data for PW70541: {'created_time': 1764965104.667973, 'last_price_update_time': 1764965104.667984, 'auction_closing_time': 1765039007.0}
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW70541') HTTP/1.1" 204 0
2025-12-05 20:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_5f2484f860ee519027b20a88f6ff2696.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5f2484f860ee519027b20a88f6ff2696.jpg not downloaded yet
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_a6c60eb84979c6b00a0e35064c6e89f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a6c60eb84979c6b00a0e35064c6e89f1.jpg not downloaded yet
2025-12-05 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV22588/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f7010>
2025-12-05 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_c313e2aee5d1f34e9bac2668c1a50fda.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_c313e2aee5d1f34e9bac2668c1a50fda.jpg saved to cache
2025-12-05 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05dae10>
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_bce9d15da7fe79c4876489b6ee785523.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bce9d15da7fe79c4876489b6ee785523.jpg saved to cache
2025-12-05 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a4c10>
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_bc9f6bc0d3baa1cf1bba5ef56fe4d55d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bc9f6bc0d3baa1cf1bba5ef56fe4d55d.jpg saved to cache
2025-12-05 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3610550>
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_f907c42de9003fb3dc3d3a6108f70c67.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_f907c42de9003fb3dc3d3a6108f70c67.jpg saved to cache
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2eeac9871dc15c2d34dbbdf7e00e3e2c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_90a428e5f3e6b4db6fbd3020edbc3fe5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_90a428e5f3e6b4db6fbd3020edbc3fe5.jpg not downloaded yet
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_e6a6e7d53119b9f113b72be98a10a434.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_e6a6e7d53119b9f113b72be98a10a434.jpg not downloaded yet
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_04128650930de0fc3b8e9869f1c6485c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_b09ff979107bada3d99736cc96b7e364.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_54ffb6f134e046f2af2c4cbef9f51142.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_0c7dabbb9c8f6596968d450a74cbc09b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_457a011b9cbd565634aa859c910193ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_b855b495cd541a00f2c8910176fb9137.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_5b607f8ab22781c185d648a95a2dbf02.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5b607f8ab22781c185d648a95a2dbf02.jpg not downloaded yet
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_00b960e3362911a89215ce1234fb21cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_00b960e3362911a89215ce1234fb21cf.jpg not downloaded yet
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9febeb9bb542d60c9d8b41b329c632ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_9417f995709de13d39b6952eafd670b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_9417f995709de13d39b6952eafd670b6.jpg not downloaded yet
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_4ced4b88ff82109c0b621aa9f572ae3f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_4ced4b88ff82109c0b621aa9f572ae3f.jpg not downloaded yet
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8d57075d70ebd81027cc356efd6cc701.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_957b10d4d1d75a492246b8307dc65288.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_957b10d4d1d75a492246b8307dc65288.jpg not downloaded yet
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_a1a30c8f6c7cad8f07f37dff70c5242d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a1a30c8f6c7cad8f07f37dff70c5242d.jpg not downloaded yet
2025-12-05 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae012aa90>
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_2eeac9871dc15c2d34dbbdf7e00e3e2c.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2eeac9871dc15c2d34dbbdf7e00e3e2c.jpg saved to cache
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_ef2c48bf20f15e287f3f8a8a13e5dd78.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_61f07448e47e38cb15a70b1902b1eb12.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_94392b950fe7015a61ea54ef4bded1a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_94392b950fe7015a61ea54ef4bded1a5.jpg not downloaded yet
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5f2484f860ee519027b20a88f6ff2696.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_36c45708c4512a4ee619dd9d8d797d24.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_e129e226e4d75bca9f2741a3350e95d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a6c60eb84979c6b00a0e35064c6e89f1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_55999978c3acb445bb06be51213c385b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f8fd0>
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_04128650930de0fc3b8e9869f1c6485c.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_04128650930de0fc3b8e9869f1c6485c.jpg saved to cache
2025-12-05 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3717050>
2025-12-05 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_b09ff979107bada3d99736cc96b7e364.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_b09ff979107bada3d99736cc96b7e364.jpg saved to cache
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae012b990>
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_54ffb6f134e046f2af2c4cbef9f51142.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_54ffb6f134e046f2af2c4cbef9f51142.jpg saved to cache
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0252fd0>
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_0c7dabbb9c8f6596968d450a74cbc09b.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_0c7dabbb9c8f6596968d450a74cbc09b.jpg saved to cache
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0129690>
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_457a011b9cbd565634aa859c910193ca.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_457a011b9cbd565634aa859c910193ca.jpg saved to cache
2025-12-05 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014fdd0>
2025-12-05 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_b855b495cd541a00f2c8910176fb9137.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_b855b495cd541a00f2c8910176fb9137.jpg saved to cache
2025-12-05 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3728cd0>
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F21%252Fee21899634bd5db53dabee6b215439c4%252Fpa%252FDP28978_9febeb9bb542d60c9d8b41b329c632ca.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9febeb9bb542d60c9d8b41b329c632ca.jpg saved to cache
2025-12-05 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4a198e5-cb7a-5e24-a6e2-812de56febdc
2025-12-05 20:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4a198e5-cb7a-5e24-a6e2-812de56febdc, skipping ID generation
2025-12-05 20:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a198e5-cb7a-5e24-a6e2-812de56febdc with scrape type 1
2025-12-05 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a4a198e5-cb7a-5e24-a6e2-812de56febdc from tracking dictionaries
2025-12-05 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4a198e5-cb7a-5e24-a6e2-812de56febdc sending to next pipeline
2025-12-05 20:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4a198e5-cb7a-5e24-a6e2-812de56febdc, identifier: DP28978
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0377590>
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_8d57075d70ebd81027cc356efd6cc701.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8d57075d70ebd81027cc356efd6cc701.jpg saved to cache
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_af066f214120094bbce72420f0e2df91.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_af066f214120094bbce72420f0e2df91.jpg not downloaded yet
2025-12-05 20:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4a198e5-cb7a-5e24-a6e2-812de56febdc with identifier: DP28978
2025-12-05 20:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4a198e5-cb7a-5e24-a6e2-812de56febdc with identifier: DP28978
2025-12-05 20:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
2025-12-05 20:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a4a198e5-cb7a-5e24-a6e2-812de56febdc spider: auto1.it
2025-12-05 20:05:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a4a198e5-cb7a-5e24-a6e2-812de56febdc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:04:58Z',
 'fuel_type': 'diesel',
 'id': 'a4a198e5-cb7a-5e24-a6e2-812de56febdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP28978',
 'listing': 'auction',
 'location': 'IT, Segrate',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 19260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_714f4d8c79bdbf764e7adc8e0213a013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_520c831ba0c9aec567555bafc0403a05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_b5f07a46c4a1eeda1361112b2b074ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_d062a564b9c4cd176f67ee3dc460d291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2575645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9febeb9bb542d60c9d8b41b329c632ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2466523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2078874e5685266d75d0afb7265443d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2473079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_7c59fd190daf05b565e8d41bedc765e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2bef3957c92570bf17dd812b76c91da9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9fa658ab81904f2de0716f6adbedd2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2387748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_2eeac9871dc15c2d34dbbdf7e00e3e2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0023e7b952b6d6ebe7ee9e318558c62c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_a2927594d54542cbd68b3008f074eb15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_9c03d1f8b7915b3c96e172f459dd5dff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2375453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_c313e2aee5d1f34e9bac2668c1a50fda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a198e5-cb7a-5e24-a6e2-812de56febdc/a4a198e5-cb7a-5e24-a6e2-812de56febdc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/21/ee21899634bd5db53dabee6b215439c4/pa/DP28978_0e4d5c6807adebee425825db67b6ca6e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 Blue dCi Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2021}
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP28978%27 HTTP/1.1" 200 None
2025-12-05 20:05:09 [auto1.it] INFO: Saving data for DP28978: {'created_time': 1764965109.40071, 'last_price_update_time': 1764965109.40072, 'auction_closing_time': 1765037098.0}
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP28978') HTTP/1.1" 204 0
2025-12-05 20:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_685df93e1f2db5eb481c329d96038d0b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_9382694310a9e4c37f11d13203de4ceb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_9382694310a9e4c37f11d13203de4ceb.jpg not downloaded yet
2025-12-05 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC65612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03fc950>
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F61%252F5761fad872314ebae765de006412b4bf%252Fpa%252FAF20385_ef2c48bf20f15e287f3f8a8a13e5dd78.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_ef2c48bf20f15e287f3f8a8a13e5dd78.jpg saved to cache
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a5047b41-8d91-5f22-9388-a0f0732cf675
2025-12-05 20:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5047b41-8d91-5f22-9388-a0f0732cf675, skipping ID generation
2025-12-05 20:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5047b41-8d91-5f22-9388-a0f0732cf675 with scrape type 1
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a5047b41-8d91-5f22-9388-a0f0732cf675 from tracking dictionaries
2025-12-05 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5047b41-8d91-5f22-9388-a0f0732cf675 sending to next pipeline
2025-12-05 20:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5047b41-8d91-5f22-9388-a0f0732cf675, identifier: AF20385
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae012a550>
2025-12-05 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_61f07448e47e38cb15a70b1902b1eb12.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_61f07448e47e38cb15a70b1902b1eb12.jpg saved to cache
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae006ae50>
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_5f2484f860ee519027b20a88f6ff2696.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5f2484f860ee519027b20a88f6ff2696.jpg saved to cache
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a7750>
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_36c45708c4512a4ee619dd9d8d797d24.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_36c45708c4512a4ee619dd9d8d797d24.jpg saved to cache
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0187c90>
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_e129e226e4d75bca9f2741a3350e95d9.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_e129e226e4d75bca9f2741a3350e95d9.jpg saved to cache
2025-12-05 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0315550>
2025-12-05 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_a6c60eb84979c6b00a0e35064c6e89f1.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a6c60eb84979c6b00a0e35064c6e89f1.jpg saved to cache
2025-12-05 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0128c50>
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_55999978c3acb445bb06be51213c385b.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_55999978c3acb445bb06be51213c385b.jpg saved to cache
2025-12-05 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_731fdb120421c241905efb185a6bea61.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385
2025-12-05 20:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385
2025-12-05 20:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5047b41-8d91-5f22-9388-a0f0732cf675 with identifier: AF20385 to the API
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_ef2c48bf20f15e287f3f8a8a13e5dd78.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 114,
 'expiration_date': '2025-12-06T16:00:48Z',
 'fuel_type': 'petrol',
 'id': 'a5047b41-8d91-5f22-9388-a0f0732cf675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF20385',
 'listing': 'auction',
 'location': 'IT, Cagliari',
 'make': 'EVO',
 'model': '4',
 'odometer': 28797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6d8b4628d6f915722122d6b18e2574a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301338,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_6ff922162598f931cc69d2c9b5a196dc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_202a0512f064b9955b8830533cd9dd41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_b72218345582e0aed38fcbaef2add5cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_331ab985bfc2d2e68e3f428c04f7003c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_5ea365d92d9025e378397e6065f5873f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242196,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_597be23609e7b97312e215bd16baa240.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_9840038f3fff5c8a47e5a146222faf47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320090,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bce9d15da7fe79c4876489b6ee785523.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8a170d8cfeece43451fef03a0f059087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282884,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_bc9f6bc0d3baa1cf1bba5ef56fe4d55d.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_eb92f0321c41a655ebb4fe5f417b735a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_98d335e1b01379a2ef0ca467bb2f13e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270996,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_ef2c48bf20f15e287f3f8a8a13e5dd78.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5047b41-8d91-5f22-9388-a0f0732cf675/a5047b41-8d91-5f22-9388-a0f0732cf675_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/61/5761fad872314ebae765de006412b4bf/pa/AF20385_8d57075d70ebd81027cc356efd6cc701.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'EVO 4 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF20385%27 HTTP/1.1" 200 None
2025-12-05 20:05:11 [auto1.it] INFO: Saving data for AF20385: {'created_time': 1764965111.790654, 'last_price_update_time': 1764965111.790666, 'auction_closing_time': 1765036848.0}
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF20385') HTTP/1.1" 204 0
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_94392b950fe7015a61ea54ef4bded1a5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_957b10d4d1d75a492246b8307dc65288.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_543abce9bba570146241f26a2e0fcc5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_543abce9bba570146241f26a2e0fcc5c.jpg not downloaded yet
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL04510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP66888> (referer: https://www.auto1.com/v1/car-details-view/ZP66888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA79418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5b607f8ab22781c185d648a95a2dbf02.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_4ced4b88ff82109c0b621aa9f572ae3f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_00b960e3362911a89215ce1234fb21cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a1a30c8f6c7cad8f07f37dff70c5242d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_9417f995709de13d39b6952eafd670b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP56033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_265bde72b17342bbd9077699ff260740.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_265bde72b17342bbd9077699ff260740.jpg not downloaded yet
2025-12-05 20:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae006c590>
2025-12-05 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_685df93e1f2db5eb481c329d96038d0b.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_685df93e1f2db5eb481c329d96038d0b.jpg saved to cache
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f6750>
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_731fdb120421c241905efb185a6bea61.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_731fdb120421c241905efb185a6bea61.jpg saved to cache
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_af066f214120094bbce72420f0e2df91.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_90a428e5f3e6b4db6fbd3020edbc3fe5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_9382694310a9e4c37f11d13203de4ceb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_e6a6e7d53119b9f113b72be98a10a434.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a9250>
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_94392b950fe7015a61ea54ef4bded1a5.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_94392b950fe7015a61ea54ef4bded1a5.jpg saved to cache
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05ce7d0>
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_957b10d4d1d75a492246b8307dc65288.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_957b10d4d1d75a492246b8307dc65288.jpg saved to cache
2025-12-05 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e89c190-6e6e-58c9-9e83-14a7f32a0501 with identifier: ZP66888
2025-12-05 20:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e89c190-6e6e-58c9-9e83-14a7f32a0501 with scrape type 2
2025-12-05 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e89c190-6e6e-58c9-9e83-14a7f32a0501 with scrape type 2
2025-12-05 20:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e89c190-6e6e-58c9-9e83-14a7f32a0501, identifier: ZP66888
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0091610>
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_5b607f8ab22781c185d648a95a2dbf02.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5b607f8ab22781c185d648a95a2dbf02.jpg saved to cache
2025-12-05 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05ce0d0>
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_4ced4b88ff82109c0b621aa9f572ae3f.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_4ced4b88ff82109c0b621aa9f572ae3f.jpg saved to cache
2025-12-05 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0627510>
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_00b960e3362911a89215ce1234fb21cf.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_00b960e3362911a89215ce1234fb21cf.jpg saved to cache
2025-12-05 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01d4450>
2025-12-05 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_a1a30c8f6c7cad8f07f37dff70c5242d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a1a30c8f6c7cad8f07f37dff70c5242d.jpg saved to cache
2025-12-05 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37b3150>
2025-12-05 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_9417f995709de13d39b6952eafd670b6.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_9417f995709de13d39b6952eafd670b6.jpg saved to cache
2025-12-05 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e89c190-6e6e-58c9-9e83-14a7f32a0501 with identifier: ZP66888
2025-12-05 20:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e89c190-6e6e-58c9-9e83-14a7f32a0501 with identifier: ZP66888
2025-12-05 20:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e89c190-6e6e-58c9-9e83-14a7f32a0501 with identifier: ZP66888 to the API
2025-12-05 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP66888>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2025-12-06T16:19:40Z',
 'fuel_type': 'diesel',
 'id': '1e89c190-6e6e-58c9-9e83-14a7f32a0501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP66888',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 121085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D180 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2019}
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66888%27 HTTP/1.1" 200 None
2025-12-05 20:05:15 [auto1.it] INFO: Saving data for ZP66888: {'auction_closing_time': 1765037980.0, 'created_time': 1761818579.600761, 'last_price_update_time': 1764965115.330416}
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZP66888') HTTP/1.1" 204 0
2025-12-05 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_543abce9bba570146241f26a2e0fcc5c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0196890>
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_af066f214120094bbce72420f0e2df91.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_af066f214120094bbce72420f0e2df91.jpg saved to cache
2025-12-05 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b5ad0>
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F16%252F53169eae14c73b62c45736094641006f%252Fpa%252FMJ70755_90a428e5f3e6b4db6fbd3020edbc3fe5.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_90a428e5f3e6b4db6fbd3020edbc3fe5.jpg saved to cache
2025-12-05 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 01955256-33f6-5ec7-8f47-9005beb661a5
2025-12-05 20:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01955256-33f6-5ec7-8f47-9005beb661a5, skipping ID generation
2025-12-05 20:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01955256-33f6-5ec7-8f47-9005beb661a5 with scrape type 1
2025-12-05 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 01955256-33f6-5ec7-8f47-9005beb661a5 from tracking dictionaries
2025-12-05 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01955256-33f6-5ec7-8f47-9005beb661a5 sending to next pipeline
2025-12-05 20:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01955256-33f6-5ec7-8f47-9005beb661a5, identifier: MJ70755
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0489cd0>
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_9382694310a9e4c37f11d13203de4ceb.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_9382694310a9e4c37f11d13203de4ceb.jpg saved to cache
2025-12-05 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae045e0d0>
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_e6a6e7d53119b9f113b72be98a10a434.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_e6a6e7d53119b9f113b72be98a10a434.jpg saved to cache
2025-12-05 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01955256-33f6-5ec7-8f47-9005beb661a5 with identifier: MJ70755
2025-12-05 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01955256-33f6-5ec7-8f47-9005beb661a5 with identifier: MJ70755
2025-12-05 20:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01955256-33f6-5ec7-8f47-9005beb661a5 with identifier: MJ70755 to the API
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_90a428e5f3e6b4db6fbd3020edbc3fe5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:11:44Z',
 'fuel_type': 'diesel',
 'id': '01955256-33f6-5ec7-8f47-9005beb661a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ70755',
 'listing': 'auction',
 'location': 'IT, Modena',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 61666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_830c36ddc312f73d5387ed4420445be9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_03cb7df2eaac8d3e70289bbb415322d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_f907c42de9003fb3dc3d3a6108f70c67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_36c45708c4512a4ee619dd9d8d797d24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_61f07448e47e38cb15a70b1902b1eb12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_e129e226e4d75bca9f2741a3350e95d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_457a011b9cbd565634aa859c910193ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_04128650930de0fc3b8e9869f1c6485c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_b855b495cd541a00f2c8910176fb9137.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_731fdb120421c241905efb185a6bea61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5f2484f860ee519027b20a88f6ff2696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_90a428e5f3e6b4db6fbd3020edbc3fe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_5b607f8ab22781c185d648a95a2dbf02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_9417f995709de13d39b6952eafd670b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01955256-33f6-5ec7-8f47-9005beb661a5/01955256-33f6-5ec7-8f47-9005beb661a5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/16/53169eae14c73b62c45736094641006f/pa/MJ70755_957b10d4d1d75a492246b8307dc65288.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF E-Performance Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2019}
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ70755%27 HTTP/1.1" 200 None
2025-12-05 20:05:16 [auto1.it] INFO: Saving data for MJ70755: {'created_time': 1764965116.914123, 'last_price_update_time': 1764965116.914132, 'auction_closing_time': 1765037504.0}
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ70755') HTTP/1.1" 204 0
2025-12-05 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_265bde72b17342bbd9077699ff260740.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP34580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV82376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK45247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV22588> (referer: https://www.auto1.com/v1/car-details-view/AV22588/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK25750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT07834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0160c10>
2025-12-05 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_543abce9bba570146241f26a2e0fcc5c.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_543abce9bba570146241f26a2e0fcc5c.jpg saved to cache
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ04394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0098e50>
2025-12-05 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F9a%252Fc79a1073cb3e208a50cd39d149a67975%252Fpa%252FVP46319_265bde72b17342bbd9077699ff260740.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_265bde72b17342bbd9077699ff260740.jpg saved to cache
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d
2025-12-05 20:05:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d, skipping ID generation
2025-12-05 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d with scrape type 1
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d from tracking dictionaries
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d sending to next pipeline
2025-12-05 20:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d, identifier: VP46319
2025-12-05 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea7335c8-8bfe-5454-9553-45f8495b4ce5 with identifier: AV22588
2025-12-05 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea7335c8-8bfe-5454-9553-45f8495b4ce5 with scrape type 1
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ea7335c8-8bfe-5454-9553-45f8495b4ce5
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_dc3309f0eaf96e6594097410bb13951b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_dc3309f0eaf96e6594097410bb13951b.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_9ee7809c8b3b672706b0405e93b43b48.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9ee7809c8b3b672706b0405e93b43b48.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_5006658b5b8806c7a0ddb27edb1b4257.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_5006658b5b8806c7a0ddb27edb1b4257.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_90103664005cbdb8216553c0ee723cd0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_90103664005cbdb8216553c0ee723cd0.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_65a9c6147eb69162c11c1963153c21c4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_65a9c6147eb69162c11c1963153c21c4.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_33a6d02d8d1ae7f6e12b5d89ed831540.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_33a6d02d8d1ae7f6e12b5d89ed831540.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_6e02ab05add059eea700cbaa439f7605.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_6e02ab05add059eea700cbaa439f7605.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_9b58117de989b13e1e82b7cfb198bdda.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9b58117de989b13e1e82b7cfb198bdda.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_8510b2320dc41466c6b10782e3feb33f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_8510b2320dc41466c6b10782e3feb33f.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_5312fe663b82f7008eddb2ee41c4cebd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_5312fe663b82f7008eddb2ee41c4cebd.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_9c87fe8719fcf5eef2e77056960aaa3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9c87fe8719fcf5eef2e77056960aaa3a.jpg already downloaded
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_eddd9bcfd1fbfa31d93c1f252cbf691f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_eddd9bcfd1fbfa31d93c1f252cbf691f.jpg already downloaded
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_30926c272e294ee2bd5569eba7902be0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_30926c272e294ee2bd5569eba7902be0.jpg already downloaded
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_0d2fc1de87adda6d2de87ac9029c3de3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_0d2fc1de87adda6d2de87ac9029c3de3.jpg already downloaded
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb5%252F5eb5476028ad43a010e01c63d7736b85%252Fpa%252FAV22588_cb58a5ab44fcf7fa49c16a20069f775a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_cb58a5ab44fcf7fa49c16a20069f775a.jpg already downloaded
2025-12-05 20:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea7335c8-8bfe-5454-9553-45f8495b4ce5, identifier: AV22588
2025-12-05 20:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d with identifier: VP46319
2025-12-05 20:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d with identifier: VP46319
2025-12-05 20:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150351 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150351
2025-12-05 20:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d spider: auto1.it
2025-12-05 20:05:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 7a6e2a39-8b2e-58e4-af58-e28e03b71a4d due to rule: high_mileage_for_country.json, error: 150351 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150351
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:10:03Z',
 'fuel_type': 'petrol',
 'id': '7a6e2a39-8b2e-58e4-af58-e28e03b71a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP46319',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 150351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_55999978c3acb445bb06be51213c385b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_b09ff979107bada3d99736cc96b7e364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_54ffb6f134e046f2af2c4cbef9f51142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_0c7dabbb9c8f6596968d450a74cbc09b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_685df93e1f2db5eb481c329d96038d0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a6c60eb84979c6b00a0e35064c6e89f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_e6a6e7d53119b9f113b72be98a10a434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_00b960e3362911a89215ce1234fb21cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_4ced4b88ff82109c0b621aa9f572ae3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_a1a30c8f6c7cad8f07f37dff70c5242d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_94392b950fe7015a61ea54ef4bded1a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_af066f214120094bbce72420f0e2df91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_9382694310a9e4c37f11d13203de4ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_543abce9bba570146241f26a2e0fcc5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a6e2a39-8b2e-58e4-af58-e28e03b71a4d/7a6e2a39-8b2e-58e4-af58-e28e03b71a4d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/9a/c79a1073cb3e208a50cd39d149a67975/pa/VP46319_265bde72b17342bbd9077699ff260740.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP46319%27 HTTP/1.1" 200 None
2025-12-05 20:05:18 [auto1.it] INFO: Saving data for VP46319: {'created_time': 1764965118.356791, 'last_price_update_time': 1764965118.356801, 'auction_closing_time': 1765037403.0}
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP46319') HTTP/1.1" 204 0
2025-12-05 20:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea7335c8-8bfe-5454-9553-45f8495b4ce5 with identifier: AV22588
2025-12-05 20:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea7335c8-8bfe-5454-9553-45f8495b4ce5 with identifier: AV22588
2025-12-05 20:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea7335c8-8bfe-5454-9553-45f8495b4ce5 with identifier: AV22588 to the API
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV22588>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:18:09Z',
 'fuel_type': 'diesel',
 'id': 'ea7335c8-8bfe-5454-9553-45f8495b4ce5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV22588',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 81372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_dc3309f0eaf96e6594097410bb13951b.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9ee7809c8b3b672706b0405e93b43b48.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_5006658b5b8806c7a0ddb27edb1b4257.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_90103664005cbdb8216553c0ee723cd0.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_65a9c6147eb69162c11c1963153c21c4.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_33a6d02d8d1ae7f6e12b5d89ed831540.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_6e02ab05add059eea700cbaa439f7605.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9b58117de989b13e1e82b7cfb198bdda.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_8510b2320dc41466c6b10782e3feb33f.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_5312fe663b82f7008eddb2ee41c4cebd.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9c87fe8719fcf5eef2e77056960aaa3a.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_eddd9bcfd1fbfa31d93c1f252cbf691f.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_30926c272e294ee2bd5569eba7902be0.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_0d2fc1de87adda6d2de87ac9029c3de3.jpg',
                'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_cb58a5ab44fcf7fa49c16a20069f775a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_dc3309f0eaf96e6594097410bb13951b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2698151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9ee7809c8b3b672706b0405e93b43b48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_5006658b5b8806c7a0ddb27edb1b4257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_90103664005cbdb8216553c0ee723cd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_65a9c6147eb69162c11c1963153c21c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_33a6d02d8d1ae7f6e12b5d89ed831540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_6e02ab05add059eea700cbaa439f7605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9b58117de989b13e1e82b7cfb198bdda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_8510b2320dc41466c6b10782e3feb33f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_5312fe663b82f7008eddb2ee41c4cebd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710372,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_9c87fe8719fcf5eef2e77056960aaa3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670775,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_eddd9bcfd1fbfa31d93c1f252cbf691f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_30926c272e294ee2bd5569eba7902be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_0d2fc1de87adda6d2de87ac9029c3de3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7335c8-8bfe-5454-9553-45f8495b4ce5/ea7335c8-8bfe-5454-9553-45f8495b4ce5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b5/5eb5476028ad43a010e01c63d7736b85/pa/AV22588_cb58a5ab44fcf7fa49c16a20069f775a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV22588%27 HTTP/1.1" 200 None
2025-12-05 20:05:18 [auto1.it] INFO: Saving data for AV22588: {'created_time': 1764965118.716779, 'last_price_update_time': 1764965118.71679, 'auction_closing_time': 1765037889.0}
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AV22588') HTTP/1.1" 204 0
2025-12-05 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF17788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS94947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF57378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN81119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK30894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC65612> (referer: https://www.auto1.com/v1/car-details-view/PC65612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP56033> (referer: https://www.auto1.com/v1/car-details-view/MP56033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d580fe-21c1-5517-a2c3-987bd405d8d7 with identifier: PC65612
2025-12-05 20:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d580fe-21c1-5517-a2c3-987bd405d8d7 with scrape type 2
2025-12-05 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37d580fe-21c1-5517-a2c3-987bd405d8d7 with scrape type 2
2025-12-05 20:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 37d580fe-21c1-5517-a2c3-987bd405d8d7, identifier: PC65612
2025-12-05 20:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 37d580fe-21c1-5517-a2c3-987bd405d8d7 with identifier: PC65612
2025-12-05 20:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 37d580fe-21c1-5517-a2c3-987bd405d8d7 with identifier: PC65612
2025-12-05 20:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 37d580fe-21c1-5517-a2c3-987bd405d8d7 with identifier: PC65612 to the API
2025-12-05 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC65612>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 280,
 'expiration_date': '2025-12-06T16:25:02Z',
 'fuel_type': 'petrol',
 'id': '37d580fe-21c1-5517-a2c3-987bd405d8d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC65612',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 39913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Ti Q4',
 'transmission': 'automatic',
 'trim': 'Ti Q4',
 'year': 2021}
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC65612%27 HTTP/1.1" 200 None
2025-12-05 20:05:20 [auto1.it] INFO: Saving data for PC65612: {'auction_closing_time': 1765038302.0, 'created_time': 1763496450.115577, 'last_price_update_time': 1764965120.159352}
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PC65612') HTTP/1.1" 204 0
2025-12-05 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL25124> (referer: https://www.auto1.com/v1/car-details-view/TL25124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA79418> (referer: https://www.auto1.com/v1/car-details-view/GA79418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a6d1b6-ee5a-531c-b067-c554dc96517f with identifier: MP56033
2025-12-05 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a6d1b6-ee5a-531c-b067-c554dc96517f with scrape type 2
2025-12-05 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a6d1b6-ee5a-531c-b067-c554dc96517f with scrape type 2
2025-12-05 20:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40a6d1b6-ee5a-531c-b067-c554dc96517f, identifier: MP56033
2025-12-05 20:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40a6d1b6-ee5a-531c-b067-c554dc96517f with identifier: MP56033
2025-12-05 20:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40a6d1b6-ee5a-531c-b067-c554dc96517f with identifier: MP56033
2025-12-05 20:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40a6d1b6-ee5a-531c-b067-c554dc96517f with identifier: MP56033 to the API
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP56033>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2025-12-06T16:21:47Z',
 'fuel_type': 'diesel',
 'id': '40a6d1b6-ee5a-531c-b067-c554dc96517f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP56033',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 65583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Xpossible 4WD',
 'transmission': 'automatic',
 'trim': 'Xpossible 4WD',
 'year': 2018}
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP56033%27 HTTP/1.1" 200 None
2025-12-05 20:05:20 [auto1.it] INFO: Saving data for MP56033: {'auction_closing_time': 1765038107.0, 'created_time': 1762805060.771975, 'last_price_update_time': 1764965120.891968}
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP56033') HTTP/1.1" 204 0
2025-12-05 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF76869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF60183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL04510> (referer: https://www.auto1.com/v1/car-details-view/FL04510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21de5580-687c-55aa-9177-dc4d8fafe975 with identifier: TL25124
2025-12-05 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21de5580-687c-55aa-9177-dc4d8fafe975 with scrape type 1
2025-12-05 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_e49b01c526d31c2b72750a8f49751e62.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_e49b01c526d31c2b72750a8f49751e62.jpg not downloaded yet
2025-12-05 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29e64cb4-68e7-5dce-8825-7134495e540d with identifier: GA79418
2025-12-05 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29e64cb4-68e7-5dce-8825-7134495e540d with scrape type 2
2025-12-05 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29e64cb4-68e7-5dce-8825-7134495e540d with scrape type 2
2025-12-05 20:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 29e64cb4-68e7-5dce-8825-7134495e540d, identifier: GA79418
2025-12-05 20:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 29e64cb4-68e7-5dce-8825-7134495e540d with identifier: GA79418
2025-12-05 20:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 29e64cb4-68e7-5dce-8825-7134495e540d with identifier: GA79418
2025-12-05 20:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 29e64cb4-68e7-5dce-8825-7134495e540d with identifier: GA79418 to the API
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GA79418>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:14:42Z',
 'fuel_type': 'petrol',
 'id': '29e64cb4-68e7-5dce-8825-7134495e540d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA79418',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 73192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2020}
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA79418%27 HTTP/1.1" 200 None
2025-12-05 20:05:21 [auto1.it] INFO: Saving data for GA79418: {'auction_closing_time': 1765037682.0, 'created_time': 1763028219.224065, 'last_price_update_time': 1764965121.441584}
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GA79418') HTTP/1.1" 204 0
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_82d5685220d62822edc506e9155d8c2e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_82d5685220d62822edc506e9155d8c2e.jpg not downloaded yet
2025-12-05 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX12723> (referer: https://www.auto1.com/v1/car-details-view/HX12723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_1ce5590513a0b96fb1b58bab231e14d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_1ce5590513a0b96fb1b58bab231e14d1.jpg not downloaded yet
2025-12-05 20:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01afd03f-eb3b-54ea-b299-30e22fb2891f with identifier: FL04510
2025-12-05 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01afd03f-eb3b-54ea-b299-30e22fb2891f with scrape type 2
2025-12-05 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01afd03f-eb3b-54ea-b299-30e22fb2891f with scrape type 2
2025-12-05 20:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01afd03f-eb3b-54ea-b299-30e22fb2891f, identifier: FL04510
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_ff33eb0dae7f8a63289c3a3f02c694bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_ff33eb0dae7f8a63289c3a3f02c694bc.jpg not downloaded yet
2025-12-05 20:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01afd03f-eb3b-54ea-b299-30e22fb2891f with identifier: FL04510
2025-12-05 20:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01afd03f-eb3b-54ea-b299-30e22fb2891f with identifier: FL04510
2025-12-05 20:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01afd03f-eb3b-54ea-b299-30e22fb2891f with identifier: FL04510 to the API
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL04510>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:21:38Z',
 'fuel_type': 'petrol',
 'id': '01afd03f-eb3b-54ea-b299-30e22fb2891f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL04510',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 47929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL04510%27 HTTP/1.1" 200 None
2025-12-05 20:05:21 [auto1.it] INFO: Saving data for FL04510: {'auction_closing_time': 1765038098.0, 'created_time': 1764360135.575798, 'last_price_update_time': 1764965121.961799}
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL04510') HTTP/1.1" 204 0
2025-12-05 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_7e8495d9567e28e51796d4eeda147718.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_7e8495d9567e28e51796d4eeda147718.jpg not downloaded yet
2025-12-05 20:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69f981f-dd4b-50e1-9f40-fec4f6addc65 with identifier: HX12723
2025-12-05 20:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69f981f-dd4b-50e1-9f40-fec4f6addc65 with scrape type 2
2025-12-05 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69f981f-dd4b-50e1-9f40-fec4f6addc65 with scrape type 2
2025-12-05 20:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b69f981f-dd4b-50e1-9f40-fec4f6addc65, identifier: HX12723
2025-12-05 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE44400> (referer: https://www.auto1.com/v1/car-details-view/GE44400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE58033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b69f981f-dd4b-50e1-9f40-fec4f6addc65 with identifier: HX12723
2025-12-05 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b69f981f-dd4b-50e1-9f40-fec4f6addc65 with identifier: HX12723
2025-12-05 20:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b69f981f-dd4b-50e1-9f40-fec4f6addc65 with identifier: HX12723 to the API
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HX12723>
{'auction_title': '',
 'c_o_2_emission_value': 19,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 320,
 'expiration_date': '2025-12-06T16:10:27Z',
 'fuel_type': 'hybrid',
 'id': 'b69f981f-dd4b-50e1-9f40-fec4f6addc65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX12723',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 101867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2021}
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX12723%27 HTTP/1.1" 200 None
2025-12-05 20:05:22 [auto1.it] INFO: Saving data for HX12723: {'auction_closing_time': 1765037427.0, 'created_time': 1763582743.783862, 'last_price_update_time': 1764965122.477462}
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HX12723') HTTP/1.1" 204 0
2025-12-05 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_82d5685220d62822edc506e9155d8c2e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_090911207c08eddaf00386fc068ec33f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_090911207c08eddaf00386fc068ec33f.jpg not downloaded yet
2025-12-05 20:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_af3f29e4fa6a894b462ef23e45bacaaa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_af3f29e4fa6a894b462ef23e45bacaaa.jpg not downloaded yet
2025-12-05 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD77820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ04394> (referer: https://www.auto1.com/v1/car-details-view/DJ04394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9726d7f8-4e4a-5d2f-8751-10f65d2f992b with identifier: GE44400
2025-12-05 20:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9726d7f8-4e4a-5d2f-8751-10f65d2f992b with scrape type 2
2025-12-05 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9726d7f8-4e4a-5d2f-8751-10f65d2f992b with scrape type 2
2025-12-05 20:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9726d7f8-4e4a-5d2f-8751-10f65d2f992b, identifier: GE44400
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_0c8322febe23e58cba1768cb3133d7e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_0c8322febe23e58cba1768cb3133d7e5.jpg not downloaded yet
2025-12-05 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9726d7f8-4e4a-5d2f-8751-10f65d2f992b with identifier: GE44400
2025-12-05 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9726d7f8-4e4a-5d2f-8751-10f65d2f992b with identifier: GE44400
2025-12-05 20:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9726d7f8-4e4a-5d2f-8751-10f65d2f992b with identifier: GE44400 to the API
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GE44400>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:00:25Z',
 'fuel_type': 'petrol',
 'id': '9726d7f8-4e4a-5d2f-8751-10f65d2f992b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE44400',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 8613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Summit',
 'transmission': 'manual',
 'trim': 'Summit',
 'year': 2024}
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE44400%27 HTTP/1.1" 200 None
2025-12-05 20:05:23 [auto1.it] INFO: Saving data for GE44400: {'auction_closing_time': 1765036825.0, 'created_time': 1764669713.802263, 'last_price_update_time': 1764965123.066843}
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE44400') HTTP/1.1" 204 0
2025-12-05 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_ff33eb0dae7f8a63289c3a3f02c694bc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_7e8495d9567e28e51796d4eeda147718.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_dc358da5c77acd8826c142be7540ea90.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_dc358da5c77acd8826c142be7540ea90.jpg not downloaded yet
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0162350>
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_82d5685220d62822edc506e9155d8c2e.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_82d5685220d62822edc506e9155d8c2e.jpg saved to cache
2025-12-05 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bad4eb5-76e4-5e25-b1ee-427c9ee77e94 with identifier: DJ04394
2025-12-05 20:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bad4eb5-76e4-5e25-b1ee-427c9ee77e94 with scrape type 2
2025-12-05 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bad4eb5-76e4-5e25-b1ee-427c9ee77e94 with scrape type 2
2025-12-05 20:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9bad4eb5-76e4-5e25-b1ee-427c9ee77e94, identifier: DJ04394
2025-12-05 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT07834> (referer: https://www.auto1.com/v1/car-details-view/NT07834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS94947> (referer: https://www.auto1.com/v1/car-details-view/SS94947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9bad4eb5-76e4-5e25-b1ee-427c9ee77e94 with identifier: DJ04394
2025-12-05 20:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9bad4eb5-76e4-5e25-b1ee-427c9ee77e94 with identifier: DJ04394
2025-12-05 20:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9bad4eb5-76e4-5e25-b1ee-427c9ee77e94 with identifier: DJ04394 to the API
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ04394>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:19:16Z',
 'fuel_type': 'petrol',
 'id': '9bad4eb5-76e4-5e25-b1ee-427c9ee77e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ04394',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 78372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ04394%27 HTTP/1.1" 200 None
2025-12-05 20:05:23 [auto1.it] INFO: Saving data for DJ04394: {'auction_closing_time': 1765037956.0, 'created_time': 1764360149.535542, 'last_price_update_time': 1764965123.806443}
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DJ04394') HTTP/1.1" 204 0
2025-12-05 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_090911207c08eddaf00386fc068ec33f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:23 [scrapy.extensions.logstats] INFO: Crawled 371 pages (at 64 pages/min), scraped 124 items (at 27 items/min)
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_87000af66bbdb0ce1315370f6687f727.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_87000af66bbdb0ce1315370f6687f727.jpg not downloaded yet
2025-12-05 20:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF17788> (referer: https://www.auto1.com/v1/car-details-view/WF17788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF57378> (referer: https://www.auto1.com/v1/car-details-view/FF57378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02ec950>
2025-12-05 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_ff33eb0dae7f8a63289c3a3f02c694bc.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_ff33eb0dae7f8a63289c3a3f02c694bc.jpg saved to cache
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae020b310>
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_7e8495d9567e28e51796d4eeda147718.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_7e8495d9567e28e51796d4eeda147718.jpg saved to cache
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_b3627226f8051ae185afa2410357ba89.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b3627226f8051ae185afa2410357ba89.jpg not downloaded yet
2025-12-05 20:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_0c8322febe23e58cba1768cb3133d7e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 with identifier: NT07834
2025-12-05 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 with scrape type 1
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_d877e27d67a9b791f91a0cc935baa21b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d877e27d67a9b791f91a0cc935baa21b.jpg not downloaded yet
2025-12-05 20:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40291716-916d-53f4-b299-039a889d448a with identifier: SS94947
2025-12-05 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40291716-916d-53f4-b299-039a889d448a with scrape type 1
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_528ff996c267a671bccbe993d42c33fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_528ff996c267a671bccbe993d42c33fe.jpg not downloaded yet
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_b403453296726df108925e71040f118d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b403453296726df108925e71040f118d.jpg not downloaded yet
2025-12-05 20:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_dc358da5c77acd8826c142be7540ea90.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_d97c30e8eefc097cdea097070250bbea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d97c30e8eefc097cdea097070250bbea.jpg not downloaded yet
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_0b8e9ba88e6fe8131e0f53e1210d2a3d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_0b8e9ba88e6fe8131e0f53e1210d2a3d.jpg not downloaded yet
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_c730711ad1cb4a62a97eedbae6bc5bc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_c730711ad1cb4a62a97eedbae6bc5bc9.jpg not downloaded yet
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0558a90>
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_090911207c08eddaf00386fc068ec33f.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_090911207c08eddaf00386fc068ec33f.jpg saved to cache
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d23ccf8e-f307-581e-8e82-38066acee14e with identifier: WF17788
2025-12-05 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d23ccf8e-f307-581e-8e82-38066acee14e with scrape type 2
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d23ccf8e-f307-581e-8e82-38066acee14e with scrape type 2
2025-12-05 20:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d23ccf8e-f307-581e-8e82-38066acee14e, identifier: WF17788
2025-12-05 20:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85121b3d-68e8-5b74-87ec-7ac90e943882 with identifier: FF57378
2025-12-05 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85121b3d-68e8-5b74-87ec-7ac90e943882 with scrape type 2
2025-12-05 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85121b3d-68e8-5b74-87ec-7ac90e943882 with scrape type 2
2025-12-05 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85121b3d-68e8-5b74-87ec-7ac90e943882, identifier: FF57378
2025-12-05 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b7b50>
2025-12-05 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_0c8322febe23e58cba1768cb3133d7e5.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_0c8322febe23e58cba1768cb3133d7e5.jpg saved to cache
2025-12-05 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_af3f29e4fa6a894b462ef23e45bacaaa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_87000af66bbdb0ce1315370f6687f727.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_1ce5590513a0b96fb1b58bab231e14d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_40ffead3fce2981b7cf963fa354cab0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_40ffead3fce2981b7cf963fa354cab0b.jpg not downloaded yet
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_83ae9e135a061a2ace34bf26fe51e091.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_83ae9e135a061a2ace34bf26fe51e091.jpg not downloaded yet
2025-12-05 20:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d23ccf8e-f307-581e-8e82-38066acee14e with identifier: WF17788
2025-12-05 20:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d23ccf8e-f307-581e-8e82-38066acee14e with identifier: WF17788
2025-12-05 20:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d23ccf8e-f307-581e-8e82-38066acee14e with identifier: WF17788 to the API
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WF17788>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:58:41Z',
 'fuel_type': 'petrol',
 'id': 'd23ccf8e-f307-581e-8e82-38066acee14e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF17788',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 55083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Longitude 4x2',
 'transmission': 'manual',
 'trim': 'Longitude 4x2',
 'year': 2022}
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF17788%27 HTTP/1.1" 200 None
2025-12-05 20:05:25 [auto1.it] INFO: Saving data for WF17788: {'auction_closing_time': 1765040321.0, 'created_time': 1764360243.452397, 'last_price_update_time': 1764965125.728998}
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WF17788') HTTP/1.1" 204 0
2025-12-05 20:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85121b3d-68e8-5b74-87ec-7ac90e943882 with identifier: FF57378
2025-12-05 20:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85121b3d-68e8-5b74-87ec-7ac90e943882 with identifier: FF57378
2025-12-05 20:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85121b3d-68e8-5b74-87ec-7ac90e943882 with identifier: FF57378 to the API
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FF57378>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2025-12-06T16:24:48Z',
 'fuel_type': 'hybrid',
 'id': '85121b3d-68e8-5b74-87ec-7ac90e943882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF57378',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 69029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.6 GDI Plug-in Hybrid High Tech',
 'transmission': 'automatic',
 'trim': 'High Tech',
 'year': 2022}
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF57378%27 HTTP/1.1" 200 None
2025-12-05 20:05:26 [auto1.it] INFO: Saving data for FF57378: {'auction_closing_time': 1765038288.0, 'created_time': 1763582771.332703, 'last_price_update_time': 1764965126.055065}
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FF57378') HTTP/1.1" 204 0
2025-12-05 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_e49b01c526d31c2b72750a8f49751e62.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_cb4150c69864ebd004da300f4a5a797f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_cb4150c69864ebd004da300f4a5a797f.jpg not downloaded yet
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_1ba4a1506741d3a163c8d1362d721731.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_1ba4a1506741d3a163c8d1362d721731.jpg not downloaded yet
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_ee2067ef0943c89ceca20948d8cb8c6a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_ee2067ef0943c89ceca20948d8cb8c6a.jpg not downloaded yet
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01229d0>
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_dc358da5c77acd8826c142be7540ea90.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_dc358da5c77acd8826c142be7540ea90.jpg saved to cache
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_3d62e9fe7f67281d036a12419ac13d6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_3d62e9fe7f67281d036a12419ac13d6e.jpg not downloaded yet
2025-12-05 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN81119> (referer: https://www.auto1.com/v1/car-details-view/FN81119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b403453296726df108925e71040f118d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_84a72f8bb71d2c06e79ae0d278e5b1d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_84a72f8bb71d2c06e79ae0d278e5b1d9.jpg not downloaded yet
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_3e718e2cc260f265065428908b4d3fd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_3e718e2cc260f265065428908b4d3fd7.jpg not downloaded yet
2025-12-05 20:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a6990>
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_af3f29e4fa6a894b462ef23e45bacaaa.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_af3f29e4fa6a894b462ef23e45bacaaa.jpg saved to cache
2025-12-05 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0162d90>
2025-12-05 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_87000af66bbdb0ce1315370f6687f727.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_87000af66bbdb0ce1315370f6687f727.jpg saved to cache
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0197750>
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_1ce5590513a0b96fb1b58bab231e14d1.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_1ce5590513a0b96fb1b58bab231e14d1.jpg saved to cache
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_c730711ad1cb4a62a97eedbae6bc5bc9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d97c30e8eefc097cdea097070250bbea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_23de6bd4fd6de66be120cbcf320a1cc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_23de6bd4fd6de66be120cbcf320a1cc9.jpg not downloaded yet
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_a7484d86ba082b8499fce22cea32db54.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_a7484d86ba082b8499fce22cea32db54.jpg not downloaded yet
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a7050>
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_e49b01c526d31c2b72750a8f49751e62.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_e49b01c526d31c2b72750a8f49751e62.jpg saved to cache
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK25750> (referer: https://www.auto1.com/v1/car-details-view/TK25750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF60183> (referer: https://www.auto1.com/v1/car-details-view/UF60183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP34580> (referer: https://www.auto1.com/v1/car-details-view/EP34580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK45247> (referer: https://www.auto1.com/v1/car-details-view/HK45247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK30894> (referer: https://www.auto1.com/v1/car-details-view/SK30894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with identifier: FN81119
2025-12-05 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with scrape type 1
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_9ad3070bacf5678b097e87c30ce0dd17.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_9ad3070bacf5678b097e87c30ce0dd17.jpg not downloaded yet
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0174850>
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_b403453296726df108925e71040f118d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b403453296726df108925e71040f118d.jpg saved to cache
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_1ba4a1506741d3a163c8d1362d721731.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_de4d4f397dd5af1e1a815dadffc92ec8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_de4d4f397dd5af1e1a815dadffc92ec8.jpg not downloaded yet
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_72730b26ecb3ab5fd8d85d9e8721a8b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_72730b26ecb3ab5fd8d85d9e8721a8b8.jpg not downloaded yet
2025-12-05 20:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_cb4150c69864ebd004da300f4a5a797f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_032efb832bd514c5d2d20434d07c9fcf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_032efb832bd514c5d2d20434d07c9fcf.jpg not downloaded yet
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f5990>
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_c730711ad1cb4a62a97eedbae6bc5bc9.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_c730711ad1cb4a62a97eedbae6bc5bc9.jpg saved to cache
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0300750>
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_d97c30e8eefc097cdea097070250bbea.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d97c30e8eefc097cdea097070250bbea.jpg saved to cache
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_3d62e9fe7f67281d036a12419ac13d6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_744606eb308b618e76aea0071ec91c29.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_744606eb308b618e76aea0071ec91c29.jpg not downloaded yet
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_c58d35db68dc28117b80f508b495dd6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_c58d35db68dc28117b80f508b495dd6e.jpg not downloaded yet
2025-12-05 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA16351> (referer: https://www.auto1.com/v1/car-details-view/KA16351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c with identifier: TK25750
2025-12-05 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c with scrape type 1
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_74cc171eec8ff1ee234d33c3cbbe6653.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_74cc171eec8ff1ee234d33c3cbbe6653.jpg not downloaded yet
2025-12-05 20:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b658e59f-346c-568c-a38d-54928cf26c45 with identifier: UF60183
2025-12-05 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b658e59f-346c-568c-a38d-54928cf26c45 with scrape type 1
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5e63c7ed077a6b28f078e7cfb5be356b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5e63c7ed077a6b28f078e7cfb5be356b.jpg not downloaded yet
2025-12-05 20:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb8aa986-0306-5809-926a-961d7d9a4148 with identifier: EP34580
2025-12-05 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb8aa986-0306-5809-926a-961d7d9a4148 with scrape type 2
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb8aa986-0306-5809-926a-961d7d9a4148 with scrape type 2
2025-12-05 20:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb8aa986-0306-5809-926a-961d7d9a4148, identifier: EP34580
2025-12-05 20:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38d20214-af48-519a-87be-8e2c9dd0fd6a with identifier: HK45247
2025-12-05 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38d20214-af48-519a-87be-8e2c9dd0fd6a with scrape type 2
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38d20214-af48-519a-87be-8e2c9dd0fd6a with scrape type 2
2025-12-05 20:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38d20214-af48-519a-87be-8e2c9dd0fd6a, identifier: HK45247
2025-12-05 20:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f4f031b-a3cd-588c-a1ec-679fdc9f33e7 with identifier: SK30894
2025-12-05 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f4f031b-a3cd-588c-a1ec-679fdc9f33e7 with scrape type 2
2025-12-05 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f4f031b-a3cd-588c-a1ec-679fdc9f33e7 with scrape type 2
2025-12-05 20:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f4f031b-a3cd-588c-a1ec-679fdc9f33e7, identifier: SK30894
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_406bdfed180323689b838709c726aae8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_406bdfed180323689b838709c726aae8.jpg not downloaded yet
2025-12-05 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV82376> (referer: https://www.auto1.com/v1/car-details-view/EV82376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb8aa986-0306-5809-926a-961d7d9a4148 with identifier: EP34580
2025-12-05 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb8aa986-0306-5809-926a-961d7d9a4148 with identifier: EP34580
2025-12-05 20:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb8aa986-0306-5809-926a-961d7d9a4148 with identifier: EP34580 to the API
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP34580>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:19:13Z',
 'fuel_type': 'petrol',
 'id': 'bb8aa986-0306-5809-926a-961d7d9a4148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP34580',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 66486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP34580%27 HTTP/1.1" 200 None
2025-12-05 20:05:29 [auto1.it] INFO: Saving data for EP34580: {'auction_closing_time': 1765037953.0, 'created_time': 1764360193.257999, 'last_price_update_time': 1764965129.415901}
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP34580') HTTP/1.1" 204 0
2025-12-05 20:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38d20214-af48-519a-87be-8e2c9dd0fd6a with identifier: HK45247
2025-12-05 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38d20214-af48-519a-87be-8e2c9dd0fd6a with identifier: HK45247
2025-12-05 20:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38d20214-af48-519a-87be-8e2c9dd0fd6a with identifier: HK45247 to the API
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK45247>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:03:59Z',
 'fuel_type': 'petrol',
 'id': '38d20214-af48-519a-87be-8e2c9dd0fd6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK45247',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 97329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Longitude 4x2',
 'transmission': 'manual',
 'trim': 'Longitude 4x2',
 'year': 2022}
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK45247%27 HTTP/1.1" 200 None
2025-12-05 20:05:29 [auto1.it] INFO: Saving data for HK45247: {'auction_closing_time': 1765037039.0, 'created_time': 1764360134.867251, 'last_price_update_time': 1764965129.762812}
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK45247') HTTP/1.1" 204 0
2025-12-05 20:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f4f031b-a3cd-588c-a1ec-679fdc9f33e7 with identifier: SK30894
2025-12-05 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f4f031b-a3cd-588c-a1ec-679fdc9f33e7 with identifier: SK30894
2025-12-05 20:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f4f031b-a3cd-588c-a1ec-679fdc9f33e7 with identifier: SK30894 to the API
2025-12-05 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SK30894>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:49:38Z',
 'fuel_type': 'petrol',
 'id': '0f4f031b-a3cd-588c-a1ec-679fdc9f33e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK30894',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 73142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Longitude 4x2',
 'transmission': 'manual',
 'trim': 'Longitude 4x2',
 'year': 2022}
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK30894%27 HTTP/1.1" 200 None
2025-12-05 20:05:30 [auto1.it] INFO: Saving data for SK30894: {'auction_closing_time': 1765039778.0, 'created_time': 1764360202.020973, 'last_price_update_time': 1764965130.140953}
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK30894') HTTP/1.1" 204 0
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_68780bb703722dd3f713babef7eb95e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_68780bb703722dd3f713babef7eb95e4.jpg not downloaded yet
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_6fc6ec0590c1cb1f601f69fecf86db94.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_6fc6ec0590c1cb1f601f69fecf86db94.jpg not downloaded yet
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_a5ead5d41b3093f366aaa20ab3e3020f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a5ead5d41b3093f366aaa20ab3e3020f.jpg not downloaded yet
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_4b0fbe7111f12106741f53ff4d211cd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_4b0fbe7111f12106741f53ff4d211cd7.jpg not downloaded yet
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0396b50>
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_1ba4a1506741d3a163c8d1362d721731.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_1ba4a1506741d3a163c8d1362d721731.jpg saved to cache
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05cee10>
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_cb4150c69864ebd004da300f4a5a797f.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_cb4150c69864ebd004da300f4a5a797f.jpg saved to cache
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_23de6bd4fd6de66be120cbcf320a1cc9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_84a72f8bb71d2c06e79ae0d278e5b1d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_f260938178ff02583c355b2f6bc61dd8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_f260938178ff02583c355b2f6bc61dd8.jpg not downloaded yet
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3621490>
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_3d62e9fe7f67281d036a12419ac13d6e.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_3d62e9fe7f67281d036a12419ac13d6e.jpg saved to cache
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f3c6a4-f9bc-5068-986e-eda1cdf57a79 with identifier: KA16351
2025-12-05 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f3c6a4-f9bc-5068-986e-eda1cdf57a79 with scrape type 2
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16f3c6a4-f9bc-5068-986e-eda1cdf57a79 with scrape type 2
2025-12-05 20:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16f3c6a4-f9bc-5068-986e-eda1cdf57a79, identifier: KA16351
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_62b12ffe6d271e59d5ed6cba2127a467.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_62b12ffe6d271e59d5ed6cba2127a467.jpg not downloaded yet
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_490f3eb08ce3cf5e10940cdbf93a25ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_490f3eb08ce3cf5e10940cdbf93a25ee.jpg not downloaded yet
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_aa30670cb659fc0deae75cc14c862a86.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_aa30670cb659fc0deae75cc14c862a86.jpg not downloaded yet
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_d48542d2f129edad34692726df833f16.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_d48542d2f129edad34692726df833f16.jpg not downloaded yet
2025-12-05 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF76869> (referer: https://www.auto1.com/v1/car-details-view/XF76869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16f3c6a4-f9bc-5068-986e-eda1cdf57a79 with identifier: KA16351
2025-12-05 20:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16f3c6a4-f9bc-5068-986e-eda1cdf57a79 with identifier: KA16351
2025-12-05 20:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16f3c6a4-f9bc-5068-986e-eda1cdf57a79 with identifier: KA16351 to the API
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KA16351>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2025-12-06T16:12:38Z',
 'fuel_type': 'diesel',
 'id': '16f3c6a4-f9bc-5068-986e-eda1cdf57a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA16351',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 91496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA16351%27 HTTP/1.1" 200 None
2025-12-05 20:05:31 [auto1.it] INFO: Saving data for KA16351: {'auction_closing_time': 1765037558.0, 'created_time': 1762286650.438874, 'last_price_update_time': 1764965131.825885}
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA16351') HTTP/1.1" 204 0
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_e88de117c425721ed4f7d7696e535262.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e88de117c425721ed4f7d7696e535262.jpg not downloaded yet
2025-12-05 20:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7256ce2-7b6b-5e76-bf39-4e591a264478 with identifier: EV82376
2025-12-05 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7256ce2-7b6b-5e76-bf39-4e591a264478 with scrape type 2
2025-12-05 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7256ce2-7b6b-5e76-bf39-4e591a264478 with scrape type 2
2025-12-05 20:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7256ce2-7b6b-5e76-bf39-4e591a264478, identifier: EV82376
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_2a19ce856081638c99925284f53e90e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a19ce856081638c99925284f53e90e5.jpg not downloaded yet
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_b21b56818f98f917b2724eff62d3d7a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_b21b56818f98f917b2724eff62d3d7a4.jpg not downloaded yet
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_a97d3aafe2fb902fee114d0f7c2c6a93.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a97d3aafe2fb902fee114d0f7c2c6a93.jpg not downloaded yet
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_255c0bb1a31682c6c7705e40e0b13ab3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_255c0bb1a31682c6c7705e40e0b13ab3.jpg not downloaded yet
2025-12-05 20:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7256ce2-7b6b-5e76-bf39-4e591a264478 with identifier: EV82376
2025-12-05 20:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7256ce2-7b6b-5e76-bf39-4e591a264478 with identifier: EV82376
2025-12-05 20:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7256ce2-7b6b-5e76-bf39-4e591a264478 with identifier: EV82376 to the API
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EV82376>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:56:02Z',
 'fuel_type': 'petrol',
 'id': 'f7256ce2-7b6b-5e76-bf39-4e591a264478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV82376',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 65451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV82376%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [auto1.it] INFO: Saving data for EV82376: {'auction_closing_time': 1765040162.0, 'created_time': 1764360202.424394, 'last_price_update_time': 1764965132.427601}
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV82376') HTTP/1.1" 204 0
2025-12-05 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_9ad3070bacf5678b097e87c30ce0dd17.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_40ffead3fce2981b7cf963fa354cab0b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_c15f44e17b4c8592b0a3436c4a7393bf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c15f44e17b4c8592b0a3436c4a7393bf.jpg not downloaded yet
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_0d887c41e12f123d800afb2053624e4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_0d887c41e12f123d800afb2053624e4d.jpg not downloaded yet
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_083f01b6f82400a0f0dbefb7e9c84e6a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_083f01b6f82400a0f0dbefb7e9c84e6a.jpg not downloaded yet
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_bb5618e5384b8e10bccaa46b18131d97.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_bb5618e5384b8e10bccaa46b18131d97.jpg not downloaded yet
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5db70df70d8fbace303056ef71db0d71.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5db70df70d8fbace303056ef71db0d71.jpg not downloaded yet
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae031a9d0>
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_23de6bd4fd6de66be120cbcf320a1cc9.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_23de6bd4fd6de66be120cbcf320a1cc9.jpg saved to cache
2025-12-05 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022dfd0>
2025-12-05 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_84a72f8bb71d2c06e79ae0d278e5b1d9.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_84a72f8bb71d2c06e79ae0d278e5b1d9.jpg saved to cache
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb with identifier: XF76869
2025-12-05 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb with scrape type 2
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb with scrape type 2
2025-12-05 20:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb, identifier: XF76869
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_e6761bca10a994f70e90e7341c67ba0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e6761bca10a994f70e90e7341c67ba0a.jpg not downloaded yet
2025-12-05 20:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb with identifier: XF76869
2025-12-05 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb with identifier: XF76869
2025-12-05 20:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb with identifier: XF76869 to the API
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XF76869>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:55:06Z',
 'fuel_type': 'diesel',
 'id': '17b3a0a1-2fe1-53a7-ae5a-daf9ee1787eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF76869',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 74427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF76869%27 HTTP/1.1" 200 None
2025-12-05 20:05:33 [auto1.it] INFO: Saving data for XF76869: {'auction_closing_time': 1765040106.0, 'created_time': 1762855245.5675, 'last_price_update_time': 1764965133.660422}
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF76869') HTTP/1.1" 204 0
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_2a6d54addf7de35af3219060002a342e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a6d54addf7de35af3219060002a342e.jpg not downloaded yet
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_4952face1ca972f524efc646805aa7cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_4952face1ca972f524efc646805aa7cf.jpg not downloaded yet
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_81aaf1e6f8a7c71e092d307fffd9d3b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_81aaf1e6f8a7c71e092d307fffd9d3b3.jpg not downloaded yet
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_af4667159361585e3f87fe30f030243c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_af4667159361585e3f87fe30f030243c.jpg not downloaded yet
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_c74055d0fbc546c3c830d5dcd5ea049c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c74055d0fbc546c3c830d5dcd5ea049c.jpg not downloaded yet
2025-12-05 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD77820> (referer: https://www.auto1.com/v1/car-details-view/SD77820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE58033> (referer: https://www.auto1.com/v1/car-details-view/BE58033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3661050>
2025-12-05 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_9ad3070bacf5678b097e87c30ce0dd17.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_9ad3070bacf5678b097e87c30ce0dd17.jpg saved to cache
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0558910>
2025-12-05 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_40ffead3fce2981b7cf963fa354cab0b.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_40ffead3fce2981b7cf963fa354cab0b.jpg saved to cache
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_032efb832bd514c5d2d20434d07c9fcf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_72730b26ecb3ab5fd8d85d9e8721a8b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_cf448be370f4673092db5956070a49ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_cf448be370f4673092db5956070a49ab.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_8d715ead3c21e58fa5ea0046969af0ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_8d715ead3c21e58fa5ea0046969af0ee.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_7c32d3f661f8d29d39b70595ca3c8a66.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_7c32d3f661f8d29d39b70595ca3c8a66.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5f22d2c6fd1620c0cfc1db796f22e365.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5f22d2c6fd1620c0cfc1db796f22e365.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_416b0ed5a5c80f30ec3c52702b21b12d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_416b0ed5a5c80f30ec3c52702b21b12d.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_abf1164668d282a3b82abb3bdb54f547.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_abf1164668d282a3b82abb3bdb54f547.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_9f785ac816ee614e2b5cf42cb7cd077d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_9f785ac816ee614e2b5cf42cb7cd077d.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_3f75cee9acd1de20a56f065fde74a81d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_3f75cee9acd1de20a56f065fde74a81d.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_a9c89f1f8fc9420c070725bba3f3cffa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a9c89f1f8fc9420c070725bba3f3cffa.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_381b49ba8b30eaaeb52bf77bc08ed3f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_381b49ba8b30eaaeb52bf77bc08ed3f8.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_d251c58efbc5dbcdd039f60abcb42614.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_d251c58efbc5dbcdd039f60abcb42614.jpg not downloaded yet
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_a74c80df778bcbe90287bc2c3fb57592.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a74c80df778bcbe90287bc2c3fb57592.jpg not downloaded yet
2025-12-05 20:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09003a72-e29d-5ba4-8399-27434f5d5b69 with identifier: SD77820
2025-12-05 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09003a72-e29d-5ba4-8399-27434f5d5b69 with scrape type 2
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09003a72-e29d-5ba4-8399-27434f5d5b69 with scrape type 2
2025-12-05 20:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09003a72-e29d-5ba4-8399-27434f5d5b69, identifier: SD77820
2025-12-05 20:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c57d1056-5115-57a0-b443-44685a0082f3 with identifier: BE58033
2025-12-05 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c57d1056-5115-57a0-b443-44685a0082f3 with scrape type 1
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c57d1056-5115-57a0-b443-44685a0082f3
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_9587a08af82c59bc6b694223cccb6763.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_9587a08af82c59bc6b694223cccb6763.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_891767e3ca3015a9130eced9a4d681e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_891767e3ca3015a9130eced9a4d681e7.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_b684ab70c7d836ff65b4ac5debb02bf5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_b684ab70c7d836ff65b4ac5debb02bf5.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_7d3d9534c81b24d8191d7cbed15cd466.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_7d3d9534c81b24d8191d7cbed15cd466.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_1573ead137f01bab008dd8cb83b69536.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_1573ead137f01bab008dd8cb83b69536.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_2e2044445c3a78f7031b67fa9197bd89.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_2e2044445c3a78f7031b67fa9197bd89.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_8535354c86a667d9887e3bc0b9ef7d49.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_8535354c86a667d9887e3bc0b9ef7d49.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_cafa5e2d95c44917c5a45b5d3477f77c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_cafa5e2d95c44917c5a45b5d3477f77c.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_15f716cf88ff46e365d81c4bb1b73546.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_15f716cf88ff46e365d81c4bb1b73546.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_afade444cc3a8bbdc80345df77a54634.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_afade444cc3a8bbdc80345df77a54634.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_2506ef4ef5f42e07e6d8b6dcd0d2c4e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_2506ef4ef5f42e07e6d8b6dcd0d2c4e6.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_291ba0426ac851c6bbdbe11ff46016c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_291ba0426ac851c6bbdbe11ff46016c1.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_64a579c943b904e3cda463c90b10ffe9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_64a579c943b904e3cda463c90b10ffe9.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_b01aa39bae37f8daa5b80dcca63333a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_b01aa39bae37f8daa5b80dcca63333a6.jpg already downloaded
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F32%252F043213a7910dfb075cfb9f26d15281d5%252Fpa%252FBE58033_0a850e835675df2eda5acea351883332.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_0a850e835675df2eda5acea351883332.jpg already downloaded
2025-12-05 20:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c57d1056-5115-57a0-b443-44685a0082f3, identifier: BE58033
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0092a90>
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_032efb832bd514c5d2d20434d07c9fcf.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_032efb832bd514c5d2d20434d07c9fcf.jpg saved to cache
2025-12-05 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae061e6d0>
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_72730b26ecb3ab5fd8d85d9e8721a8b8.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_72730b26ecb3ab5fd8d85d9e8721a8b8.jpg saved to cache
2025-12-05 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5e63c7ed077a6b28f078e7cfb5be356b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_4abec1e3fa65c81dd672fb53fc3adae8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_4abec1e3fa65c81dd672fb53fc3adae8.jpg not downloaded yet
2025-12-05 20:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09003a72-e29d-5ba4-8399-27434f5d5b69 with identifier: SD77820
2025-12-05 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09003a72-e29d-5ba4-8399-27434f5d5b69 with identifier: SD77820
2025-12-05 20:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09003a72-e29d-5ba4-8399-27434f5d5b69 with identifier: SD77820 to the API
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD77820>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:08:38Z',
 'fuel_type': 'petrol',
 'id': '09003a72-e29d-5ba4-8399-27434f5d5b69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD77820',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 74627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD77820%27 HTTP/1.1" 200 None
2025-12-05 20:05:35 [auto1.it] INFO: Saving data for SD77820: {'auction_closing_time': 1765037318.0, 'created_time': 1764360225.490538, 'last_price_update_time': 1764965135.994353}
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD77820') HTTP/1.1" 204 0
2025-12-05 20:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c57d1056-5115-57a0-b443-44685a0082f3 with identifier: BE58033
2025-12-05 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c57d1056-5115-57a0-b443-44685a0082f3 with identifier: BE58033
2025-12-05 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2025-12-05 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c57d1056-5115-57a0-b443-44685a0082f3 spider: auto1.it
2025-12-05 20:05:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c57d1056-5115-57a0-b443-44685a0082f3 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:23:25Z',
 'fuel_type': 'petrol',
 'id': 'c57d1056-5115-57a0-b443-44685a0082f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE58033',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 107699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_9587a08af82c59bc6b694223cccb6763.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_891767e3ca3015a9130eced9a4d681e7.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_b684ab70c7d836ff65b4ac5debb02bf5.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_7d3d9534c81b24d8191d7cbed15cd466.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_1573ead137f01bab008dd8cb83b69536.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_2e2044445c3a78f7031b67fa9197bd89.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_8535354c86a667d9887e3bc0b9ef7d49.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_cafa5e2d95c44917c5a45b5d3477f77c.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_15f716cf88ff46e365d81c4bb1b73546.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_afade444cc3a8bbdc80345df77a54634.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_2506ef4ef5f42e07e6d8b6dcd0d2c4e6.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_291ba0426ac851c6bbdbe11ff46016c1.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_64a579c943b904e3cda463c90b10ffe9.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_b01aa39bae37f8daa5b80dcca63333a6.jpg',
                'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_0a850e835675df2eda5acea351883332.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_9587a08af82c59bc6b694223cccb6763.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_891767e3ca3015a9130eced9a4d681e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525382,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_b684ab70c7d836ff65b4ac5debb02bf5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2382584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_7d3d9534c81b24d8191d7cbed15cd466.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_1573ead137f01bab008dd8cb83b69536.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_2e2044445c3a78f7031b67fa9197bd89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319050,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_8535354c86a667d9887e3bc0b9ef7d49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_cafa5e2d95c44917c5a45b5d3477f77c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_15f716cf88ff46e365d81c4bb1b73546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_afade444cc3a8bbdc80345df77a54634.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_2506ef4ef5f42e07e6d8b6dcd0d2c4e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_291ba0426ac851c6bbdbe11ff46016c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_64a579c943b904e3cda463c90b10ffe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_b01aa39bae37f8daa5b80dcca63333a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c57d1056-5115-57a0-b443-44685a0082f3/c57d1056-5115-57a0-b443-44685a0082f3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/32/043213a7910dfb075cfb9f26d15281d5/pa/BE58033_0a850e835675df2eda5acea351883332.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2019}
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE58033%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [auto1.it] INFO: Saving data for BE58033: {'created_time': 1764965136.221341, 'last_price_update_time': 1764965136.22135, 'auction_closing_time': 1765038205.0}
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE58033') HTTP/1.1" 204 0
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_2bb6d122de69ac572db311fe9675e013.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2bb6d122de69ac572db311fe9675e013.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_567a657d4b906fbc2bce4500e6db40ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_567a657d4b906fbc2bce4500e6db40ef.jpg not downloaded yet
2025-12-05 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_406bdfed180323689b838709c726aae8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_1d59c8802b281403e66879bc63f40697.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_1d59c8802b281403e66879bc63f40697.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_c7390bcfa4a43994fda9931511d68bd3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_c7390bcfa4a43994fda9931511d68bd3.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_8fe3b220c4afd229ffcc2b693e7d5c95.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_8fe3b220c4afd229ffcc2b693e7d5c95.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_8cd853216527b360a7b500fabd6dd9d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_8cd853216527b360a7b500fabd6dd9d6.jpg not downloaded yet
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0415d90>
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5e63c7ed077a6b28f078e7cfb5be356b.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5e63c7ed077a6b28f078e7cfb5be356b.jpg saved to cache
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_2fe220a3fb55a1516ce20ba149b85eb4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2fe220a3fb55a1516ce20ba149b85eb4.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5fa42385cd33b27ce59eaf152fbed30f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5fa42385cd33b27ce59eaf152fbed30f.jpg not downloaded yet
2025-12-05 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_f260938178ff02583c355b2f6bc61dd8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_74cc171eec8ff1ee234d33c3cbbe6653.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_848261618ad255929b4d9edba3dcc394.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_848261618ad255929b4d9edba3dcc394.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_5d18faaed2a510b2b010494997fddcd9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_5d18faaed2a510b2b010494997fddcd9.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_882b1ac6de4f3cd1044f93bc17833ea2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_882b1ac6de4f3cd1044f93bc17833ea2.jpg not downloaded yet
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3636310>
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_406bdfed180323689b838709c726aae8.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_406bdfed180323689b838709c726aae8.jpg saved to cache
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_784c09ba6a429e0d36770e9976353f95.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_784c09ba6a429e0d36770e9976353f95.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_308ba1d484ca63a86b1c75f285a2e8e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_308ba1d484ca63a86b1c75f285a2e8e5.jpg not downloaded yet
2025-12-05 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_1e7e4d56d47f7d1555f038156c0aa9d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1e7e4d56d47f7d1555f038156c0aa9d6.jpg not downloaded yet
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05f29d0>
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_f260938178ff02583c355b2f6bc61dd8.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_f260938178ff02583c355b2f6bc61dd8.jpg saved to cache
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007c110>
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_74cc171eec8ff1ee234d33c3cbbe6653.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_74cc171eec8ff1ee234d33c3cbbe6653.jpg saved to cache
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_b6b3feaee5a165e5b03ef37d6d40593a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_b6b3feaee5a165e5b03ef37d6d40593a.jpg not downloaded yet
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_1ff44ade9d455a111c0819a726e39f50.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1ff44ade9d455a111c0819a726e39f50.jpg not downloaded yet
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_255c0bb1a31682c6c7705e40e0b13ab3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a97d3aafe2fb902fee114d0f7c2c6a93.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_ee2067ef0943c89ceca20948d8cb8c6a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_528ff996c267a671bccbe993d42c33fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_0b8e9ba88e6fe8131e0f53e1210d2a3d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_3e718e2cc260f265065428908b4d3fd7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_83ae9e135a061a2ace34bf26fe51e091.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_a7484d86ba082b8499fce22cea32db54.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37afdd0>
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_255c0bb1a31682c6c7705e40e0b13ab3.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_255c0bb1a31682c6c7705e40e0b13ab3.jpg saved to cache
2025-12-05 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_4abec1e3fa65c81dd672fb53fc3adae8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_4952face1ca972f524efc646805aa7cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_af4667159361585e3f87fe30f030243c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c74055d0fbc546c3c830d5dcd5ea049c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37d69d0>
2025-12-05 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_a97d3aafe2fb902fee114d0f7c2c6a93.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a97d3aafe2fb902fee114d0f7c2c6a93.jpg saved to cache
2025-12-05 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01cc910>
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_ee2067ef0943c89ceca20948d8cb8c6a.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_ee2067ef0943c89ceca20948d8cb8c6a.jpg saved to cache
2025-12-05 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05b6d10>
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_528ff996c267a671bccbe993d42c33fe.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_528ff996c267a671bccbe993d42c33fe.jpg saved to cache
2025-12-05 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0128390>
2025-12-05 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_0b8e9ba88e6fe8131e0f53e1210d2a3d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_0b8e9ba88e6fe8131e0f53e1210d2a3d.jpg saved to cache
2025-12-05 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0521110>
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_3e718e2cc260f265065428908b4d3fd7.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_3e718e2cc260f265065428908b4d3fd7.jpg saved to cache
2025-12-05 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad366a650>
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_83ae9e135a061a2ace34bf26fe51e091.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_83ae9e135a061a2ace34bf26fe51e091.jpg saved to cache
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae017c390>
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_a7484d86ba082b8499fce22cea32db54.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_a7484d86ba082b8499fce22cea32db54.jpg saved to cache
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_b6b3feaee5a165e5b03ef37d6d40593a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1e7e4d56d47f7d1555f038156c0aa9d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1ff44ade9d455a111c0819a726e39f50.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0301210>
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_4abec1e3fa65c81dd672fb53fc3adae8.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_4abec1e3fa65c81dd672fb53fc3adae8.jpg saved to cache
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0300c90>
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_4952face1ca972f524efc646805aa7cf.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_4952face1ca972f524efc646805aa7cf.jpg saved to cache
2025-12-05 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3634650>
2025-12-05 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_af4667159361585e3f87fe30f030243c.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_af4667159361585e3f87fe30f030243c.jpg saved to cache
2025-12-05 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0397d50>
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_c74055d0fbc546c3c830d5dcd5ea049c.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c74055d0fbc546c3c830d5dcd5ea049c.jpg saved to cache
2025-12-05 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_882b1ac6de4f3cd1044f93bc17833ea2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_784c09ba6a429e0d36770e9976353f95.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_5d18faaed2a510b2b010494997fddcd9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_308ba1d484ca63a86b1c75f285a2e8e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0064950>
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_b6b3feaee5a165e5b03ef37d6d40593a.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_b6b3feaee5a165e5b03ef37d6d40593a.jpg saved to cache
2025-12-05 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae005b9d0>
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_1e7e4d56d47f7d1555f038156c0aa9d6.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1e7e4d56d47f7d1555f038156c0aa9d6.jpg saved to cache
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370e4d0>
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_1ff44ade9d455a111c0819a726e39f50.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1ff44ade9d455a111c0819a726e39f50.jpg saved to cache
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_8cd853216527b360a7b500fabd6dd9d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_848261618ad255929b4d9edba3dcc394.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0561e90>
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_882b1ac6de4f3cd1044f93bc17833ea2.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_882b1ac6de4f3cd1044f93bc17833ea2.jpg saved to cache
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b79d0>
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_784c09ba6a429e0d36770e9976353f95.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_784c09ba6a429e0d36770e9976353f95.jpg saved to cache
2025-12-05 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370e6d0>
2025-12-05 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_5d18faaed2a510b2b010494997fddcd9.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_5d18faaed2a510b2b010494997fddcd9.jpg saved to cache
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d5010>
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_308ba1d484ca63a86b1c75f285a2e8e5.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_308ba1d484ca63a86b1c75f285a2e8e5.jpg saved to cache
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_1d59c8802b281403e66879bc63f40697.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_567a657d4b906fbc2bce4500e6db40ef.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_c7390bcfa4a43994fda9931511d68bd3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0263b10>
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_8cd853216527b360a7b500fabd6dd9d6.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_8cd853216527b360a7b500fabd6dd9d6.jpg saved to cache
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0197750>
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_848261618ad255929b4d9edba3dcc394.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_848261618ad255929b4d9edba3dcc394.jpg saved to cache
2025-12-05 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_381b49ba8b30eaaeb52bf77bc08ed3f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_d251c58efbc5dbcdd039f60abcb42614.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c7bd0>
2025-12-05 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_1d59c8802b281403e66879bc63f40697.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_1d59c8802b281403e66879bc63f40697.jpg saved to cache
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae044b850>
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_567a657d4b906fbc2bce4500e6db40ef.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_567a657d4b906fbc2bce4500e6db40ef.jpg saved to cache
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007a7d0>
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_c7390bcfa4a43994fda9931511d68bd3.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_c7390bcfa4a43994fda9931511d68bd3.jpg saved to cache
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_3f75cee9acd1de20a56f065fde74a81d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a9c89f1f8fc9420c070725bba3f3cffa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01337d0>
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_381b49ba8b30eaaeb52bf77bc08ed3f8.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_381b49ba8b30eaaeb52bf77bc08ed3f8.jpg saved to cache
2025-12-05 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0194690>
2025-12-05 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_d251c58efbc5dbcdd039f60abcb42614.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_d251c58efbc5dbcdd039f60abcb42614.jpg saved to cache
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_abf1164668d282a3b82abb3bdb54f547.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_9f785ac816ee614e2b5cf42cb7cd077d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5fa42385cd33b27ce59eaf152fbed30f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d4950>
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_3f75cee9acd1de20a56f065fde74a81d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_3f75cee9acd1de20a56f065fde74a81d.jpg saved to cache
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f8110>
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_a9c89f1f8fc9420c070725bba3f3cffa.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a9c89f1f8fc9420c070725bba3f3cffa.jpg saved to cache
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2fe220a3fb55a1516ce20ba149b85eb4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5f22d2c6fd1620c0cfc1db796f22e365.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_416b0ed5a5c80f30ec3c52702b21b12d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_81aaf1e6f8a7c71e092d307fffd9d3b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c7050>
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_abf1164668d282a3b82abb3bdb54f547.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_abf1164668d282a3b82abb3bdb54f547.jpg saved to cache
2025-12-05 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f2e50>
2025-12-05 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_9f785ac816ee614e2b5cf42cb7cd077d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_9f785ac816ee614e2b5cf42cb7cd077d.jpg saved to cache
2025-12-05 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370a250>
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5fa42385cd33b27ce59eaf152fbed30f.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5fa42385cd33b27ce59eaf152fbed30f.jpg saved to cache
2025-12-05 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a6d54addf7de35af3219060002a342e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_cf448be370f4673092db5956070a49ab.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad360f350>
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_2fe220a3fb55a1516ce20ba149b85eb4.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2fe220a3fb55a1516ce20ba149b85eb4.jpg saved to cache
2025-12-05 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0156c10>
2025-12-05 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5f22d2c6fd1620c0cfc1db796f22e365.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5f22d2c6fd1620c0cfc1db796f22e365.jpg saved to cache
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a4c10>
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_416b0ed5a5c80f30ec3c52702b21b12d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_416b0ed5a5c80f30ec3c52702b21b12d.jpg saved to cache
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad360e2d0>
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_81aaf1e6f8a7c71e092d307fffd9d3b3.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_81aaf1e6f8a7c71e092d307fffd9d3b3.jpg saved to cache
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a74c80df778bcbe90287bc2c3fb57592.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5db70df70d8fbace303056ef71db0d71.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e6761bca10a994f70e90e7341c67ba0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae243a050>
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_2a6d54addf7de35af3219060002a342e.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a6d54addf7de35af3219060002a342e.jpg saved to cache
2025-12-05 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d5150>
2025-12-05 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_cf448be370f4673092db5956070a49ab.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_cf448be370f4673092db5956070a49ab.jpg saved to cache
2025-12-05 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_0d887c41e12f123d800afb2053624e4d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_bb5618e5384b8e10bccaa46b18131d97.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae037d790>
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_a74c80df778bcbe90287bc2c3fb57592.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a74c80df778bcbe90287bc2c3fb57592.jpg saved to cache
2025-12-05 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37e0610>
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_5db70df70d8fbace303056ef71db0d71.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5db70df70d8fbace303056ef71db0d71.jpg saved to cache
2025-12-05 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3712b50>
2025-12-05 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_e6761bca10a994f70e90e7341c67ba0a.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e6761bca10a994f70e90e7341c67ba0a.jpg saved to cache
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2bb6d122de69ac572db311fe9675e013.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_8fe3b220c4afd229ffcc2b693e7d5c95.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c15f44e17b4c8592b0a3436c4a7393bf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_b21b56818f98f917b2724eff62d3d7a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a7e50>
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_0d887c41e12f123d800afb2053624e4d.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_0d887c41e12f123d800afb2053624e4d.jpg saved to cache
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0562e50>
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_bb5618e5384b8e10bccaa46b18131d97.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_bb5618e5384b8e10bccaa46b18131d97.jpg saved to cache
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e88de117c425721ed4f7d7696e535262.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a19ce856081638c99925284f53e90e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae055a190>
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_2bb6d122de69ac572db311fe9675e013.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2bb6d122de69ac572db311fe9675e013.jpg saved to cache
2025-12-05 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363c810>
2025-12-05 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_8fe3b220c4afd229ffcc2b693e7d5c95.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_8fe3b220c4afd229ffcc2b693e7d5c95.jpg saved to cache
2025-12-05 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae045edd0>
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_c15f44e17b4c8592b0a3436c4a7393bf.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c15f44e17b4c8592b0a3436c4a7393bf.jpg saved to cache
2025-12-05 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad366a390>
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_b21b56818f98f917b2724eff62d3d7a4.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_b21b56818f98f917b2724eff62d3d7a4.jpg saved to cache
2025-12-05 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_62b12ffe6d271e59d5ed6cba2127a467.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_4b0fbe7111f12106741f53ff4d211cd7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_490f3eb08ce3cf5e10940cdbf93a25ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37e39d0>
2025-12-05 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4f%252F8f4f04f13ad0e048f84fb1148b497de8%252Fpa%252FFN81119_e88de117c425721ed4f7d7696e535262.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e88de117c425721ed4f7d7696e535262.jpg saved to cache
2025-12-05 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35
2025-12-05 20:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f249ce98-94a1-5ac4-b7db-5b0eb181ab35, skipping ID generation
2025-12-05 20:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with scrape type 1
2025-12-05 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f249ce98-94a1-5ac4-b7db-5b0eb181ab35 from tracking dictionaries
2025-12-05 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f249ce98-94a1-5ac4-b7db-5b0eb181ab35 sending to next pipeline
2025-12-05 20:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f249ce98-94a1-5ac4-b7db-5b0eb181ab35, identifier: FN81119
2025-12-05 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f8410>
2025-12-05 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_2a19ce856081638c99925284f53e90e5.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a19ce856081638c99925284f53e90e5.jpg saved to cache
2025-12-05 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with identifier: FN81119
2025-12-05 20:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 with identifier: FN81119
2025-12-05 20:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166572 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166572
2025-12-05 20:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 spider: auto1.it
2025-12-05 20:05:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f249ce98-94a1-5ac4-b7db-5b0eb181ab35 due to rule: high_mileage_for_country.json, error: 166572 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166572
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:12:31Z',
 'fuel_type': 'diesel',
 'id': 'f249ce98-94a1-5ac4-b7db-5b0eb181ab35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN81119',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 166572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_9ad3070bacf5678b097e87c30ce0dd17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_032efb832bd514c5d2d20434d07c9fcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_406bdfed180323689b838709c726aae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_f260938178ff02583c355b2f6bc61dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e88de117c425721ed4f7d7696e535262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c15f44e17b4c8592b0a3436c4a7393bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_e6761bca10a994f70e90e7341c67ba0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_c74055d0fbc546c3c830d5dcd5ea049c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_416b0ed5a5c80f30ec3c52702b21b12d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_381b49ba8b30eaaeb52bf77bc08ed3f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_4abec1e3fa65c81dd672fb53fc3adae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_1d59c8802b281403e66879bc63f40697.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_8cd853216527b360a7b500fabd6dd9d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_848261618ad255929b4d9edba3dcc394.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f249ce98-94a1-5ac4-b7db-5b0eb181ab35/f249ce98-94a1-5ac4-b7db-5b0eb181ab35_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4f/8f4f04f13ad0e048f84fb1148b497de8/pa/FN81119_784c09ba6a429e0d36770e9976353f95.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81119%27 HTTP/1.1" 200 None
2025-12-05 20:05:52 [auto1.it] INFO: Saving data for FN81119: {'created_time': 1764965152.233913, 'last_price_update_time': 1764965152.233927, 'auction_closing_time': 1765037551.0}
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN81119') HTTP/1.1" 204 0
2025-12-05 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_68780bb703722dd3f713babef7eb95e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_6fc6ec0590c1cb1f601f69fecf86db94.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03ff7d0>
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_62b12ffe6d271e59d5ed6cba2127a467.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_62b12ffe6d271e59d5ed6cba2127a467.jpg saved to cache
2025-12-05 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03ecb50>
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_4b0fbe7111f12106741f53ff4d211cd7.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_4b0fbe7111f12106741f53ff4d211cd7.jpg saved to cache
2025-12-05 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae009b590>
2025-12-05 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_490f3eb08ce3cf5e10940cdbf93a25ee.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_490f3eb08ce3cf5e10940cdbf93a25ee.jpg saved to cache
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_c58d35db68dc28117b80f508b495dd6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_744606eb308b618e76aea0071ec91c29.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d5490>
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_68780bb703722dd3f713babef7eb95e4.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_68780bb703722dd3f713babef7eb95e4.jpg saved to cache
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e3e90>
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_6fc6ec0590c1cb1f601f69fecf86db94.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_6fc6ec0590c1cb1f601f69fecf86db94.jpg saved to cache
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_7c32d3f661f8d29d39b70595ca3c8a66.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3712ad0>
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_c58d35db68dc28117b80f508b495dd6e.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_c58d35db68dc28117b80f508b495dd6e.jpg saved to cache
2025-12-05 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04bb310>
2025-12-05 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_744606eb308b618e76aea0071ec91c29.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_744606eb308b618e76aea0071ec91c29.jpg saved to cache
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b3627226f8051ae185afa2410357ba89.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_de4d4f397dd5af1e1a815dadffc92ec8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d877e27d67a9b791f91a0cc935baa21b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370f410>
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_7c32d3f661f8d29d39b70595ca3c8a66.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_7c32d3f661f8d29d39b70595ca3c8a66.jpg saved to cache
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK85340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL85542/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM38721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY20134> (referer: https://www.auto1.com/v1/car-details-view/KY20134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0196b10>
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F1c%252F8f1ce1f9426b6a8f8cc7ba67dbfbc93e%252Fpa%252FTL25124_b3627226f8051ae185afa2410357ba89.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b3627226f8051ae185afa2410357ba89.jpg saved to cache
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 21de5580-687c-55aa-9177-dc4d8fafe975
2025-12-05 20:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21de5580-687c-55aa-9177-dc4d8fafe975, skipping ID generation
2025-12-05 20:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21de5580-687c-55aa-9177-dc4d8fafe975 with scrape type 1
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21de5580-687c-55aa-9177-dc4d8fafe975 from tracking dictionaries
2025-12-05 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21de5580-687c-55aa-9177-dc4d8fafe975 sending to next pipeline
2025-12-05 20:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21de5580-687c-55aa-9177-dc4d8fafe975, identifier: TL25124
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b6a90>
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_de4d4f397dd5af1e1a815dadffc92ec8.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_de4d4f397dd5af1e1a815dadffc92ec8.jpg saved to cache
2025-12-05 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04f9050>
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F59%252Ff359d2dec27d821bfffe7a4923b3c6ec%252Fpa%252FNT07834_d877e27d67a9b791f91a0cc935baa21b.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d877e27d67a9b791f91a0cc935baa21b.jpg saved to cache
2025-12-05 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72
2025-12-05 20:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72, skipping ID generation
2025-12-05 20:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 with scrape type 1
2025-12-05 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 from tracking dictionaries
2025-12-05 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 sending to next pipeline
2025-12-05 20:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72, identifier: NT07834
2025-12-05 20:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21de5580-687c-55aa-9177-dc4d8fafe975 with identifier: TL25124
2025-12-05 20:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21de5580-687c-55aa-9177-dc4d8fafe975 with identifier: TL25124
2025-12-05 20:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21de5580-687c-55aa-9177-dc4d8fafe975 with identifier: TL25124 to the API
2025-12-05 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b3627226f8051ae185afa2410357ba89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:23:52Z',
 'fuel_type': 'diesel',
 'id': '21de5580-687c-55aa-9177-dc4d8fafe975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL25124',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 116603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_e49b01c526d31c2b72750a8f49751e62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_82d5685220d62822edc506e9155d8c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_1ce5590513a0b96fb1b58bab231e14d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_ff33eb0dae7f8a63289c3a3f02c694bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_7e8495d9567e28e51796d4eeda147718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_090911207c08eddaf00386fc068ec33f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_af3f29e4fa6a894b462ef23e45bacaaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_0c8322febe23e58cba1768cb3133d7e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_dc358da5c77acd8826c142be7540ea90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_87000af66bbdb0ce1315370f6687f727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b3627226f8051ae185afa2410357ba89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_b403453296726df108925e71040f118d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_c730711ad1cb4a62a97eedbae6bc5bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_cb4150c69864ebd004da300f4a5a797f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21de5580-687c-55aa-9177-dc4d8fafe975/21de5580-687c-55aa-9177-dc4d8fafe975_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/1c/8f1ce1f9426b6a8f8cc7ba67dbfbc93e/pa/TL25124_3d62e9fe7f67281d036a12419ac13d6e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2021}
2025-12-05 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL25124%27 HTTP/1.1" 200 None
2025-12-05 20:05:56 [auto1.it] INFO: Saving data for TL25124: {'created_time': 1764965156.818424, 'last_price_update_time': 1764965156.818433, 'auction_closing_time': 1765038232.0}
2025-12-05 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL25124') HTTP/1.1" 204 0
2025-12-05 20:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 with identifier: NT07834
2025-12-05 20:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 with identifier: NT07834
2025-12-05 20:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b5c88e9-dae3-52e3-9ecd-430f21c3cd72 with identifier: NT07834 to the API
2025-12-05 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d877e27d67a9b791f91a0cc935baa21b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 309,
 'expiration_date': '2025-12-06T16:30:16Z',
 'fuel_type': 'hybrid',
 'id': '3b5c88e9-dae3-52e3-9ecd-430f21c3cd72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT07834',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 78722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d877e27d67a9b791f91a0cc935baa21b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_d97c30e8eefc097cdea097070250bbea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_40ffead3fce2981b7cf963fa354cab0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_1ba4a1506741d3a163c8d1362d721731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_84a72f8bb71d2c06e79ae0d278e5b1d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_23de6bd4fd6de66be120cbcf320a1cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_de4d4f397dd5af1e1a815dadffc92ec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_744606eb308b618e76aea0071ec91c29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_68780bb703722dd3f713babef7eb95e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_62b12ffe6d271e59d5ed6cba2127a467.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a19ce856081638c99925284f53e90e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_0d887c41e12f123d800afb2053624e4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_2a6d54addf7de35af3219060002a342e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_cf448be370f4673092db5956070a49ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b5c88e9-dae3-52e3-9ecd-430f21c3cd72/3b5c88e9-dae3-52e3-9ecd-430f21c3cd72_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/59/f359d2dec27d821bfffe7a4923b3c6ec/pa/NT07834_abf1164668d282a3b82abb3bdb54f547.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P300e Hybrid R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2021}
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT07834%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [auto1.it] INFO: Saving data for NT07834: {'created_time': 1764965157.209868, 'last_price_update_time': 1764965157.209879, 'auction_closing_time': 1765038616.0}
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NT07834') HTTP/1.1" 204 0
2025-12-05 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_8d715ead3c21e58fa5ea0046969af0ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB36220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP08854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ10581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS63299/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e5ea9c-b309-5189-abd4-40dad8dde251 with identifier: KY20134
2025-12-05 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e5ea9c-b309-5189-abd4-40dad8dde251 with scrape type 1
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c5e5ea9c-b309-5189-abd4-40dad8dde251
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_37d4308e3866cf278f3727221bf08a40.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_37d4308e3866cf278f3727221bf08a40.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_9915239f3a9ff3ccaea35dee8bdcadc7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_9915239f3a9ff3ccaea35dee8bdcadc7.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_03de7baf4cdd024b81ddf6ab6f25d6da.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_03de7baf4cdd024b81ddf6ab6f25d6da.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_2cba98c4f49d1cee5c59843c573780e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_2cba98c4f49d1cee5c59843c573780e6.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_2cc95b9ae5a96aa888baaadfc5da0950.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_2cc95b9ae5a96aa888baaadfc5da0950.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_119984833fa0ddef66644567b91fb17e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_119984833fa0ddef66644567b91fb17e.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_6af955457433d8c24f784f8cd0f61718.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_6af955457433d8c24f784f8cd0f61718.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_6698dc2a05f4f401ad7836a1f28fd141.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_6698dc2a05f4f401ad7836a1f28fd141.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_a8833f9847ba5cdbfe0094ab4c3ebb3c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_a8833f9847ba5cdbfe0094ab4c3ebb3c.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_cbc09e69b5772d8cfe01418d2c01aeeb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_cbc09e69b5772d8cfe01418d2c01aeeb.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_5f64131535a1033ecd32cca059ee20ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_5f64131535a1033ecd32cca059ee20ca.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_76300d0557d5b563ec0b8b30c5fee9a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_76300d0557d5b563ec0b8b30c5fee9a6.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_955133d1419bde76f00ab8b7f84c8580.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_955133d1419bde76f00ab8b7f84c8580.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_4016c205a75ec1d13f831bc1b2305afc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_4016c205a75ec1d13f831bc1b2305afc.jpg already downloaded
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fa7%252F0ea77fe0cbdb1ec22a41a00f59c6ee78%252Fpa%252FKY20134_79f47a940aa35ac8ec4ab8723641255c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_79f47a940aa35ac8ec4ab8723641255c.jpg already downloaded
2025-12-05 20:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5e5ea9c-b309-5189-abd4-40dad8dde251, identifier: KY20134
2025-12-05 20:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5e5ea9c-b309-5189-abd4-40dad8dde251 with identifier: KY20134
2025-12-05 20:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5e5ea9c-b309-5189-abd4-40dad8dde251 with identifier: KY20134
2025-12-05 20:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c5e5ea9c-b309-5189-abd4-40dad8dde251 with identifier: KY20134 to the API
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY20134>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:21:27Z',
 'fuel_type': 'petrol',
 'id': 'c5e5ea9c-b309-5189-abd4-40dad8dde251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY20134',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 15000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_37d4308e3866cf278f3727221bf08a40.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_9915239f3a9ff3ccaea35dee8bdcadc7.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_03de7baf4cdd024b81ddf6ab6f25d6da.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_2cba98c4f49d1cee5c59843c573780e6.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_2cc95b9ae5a96aa888baaadfc5da0950.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_119984833fa0ddef66644567b91fb17e.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_6af955457433d8c24f784f8cd0f61718.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_6698dc2a05f4f401ad7836a1f28fd141.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_a8833f9847ba5cdbfe0094ab4c3ebb3c.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_cbc09e69b5772d8cfe01418d2c01aeeb.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_5f64131535a1033ecd32cca059ee20ca.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_76300d0557d5b563ec0b8b30c5fee9a6.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_955133d1419bde76f00ab8b7f84c8580.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_4016c205a75ec1d13f831bc1b2305afc.jpg',
                'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_79f47a940aa35ac8ec4ab8723641255c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_37d4308e3866cf278f3727221bf08a40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2822622,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_9915239f3a9ff3ccaea35dee8bdcadc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_03de7baf4cdd024b81ddf6ab6f25d6da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_2cba98c4f49d1cee5c59843c573780e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_2cc95b9ae5a96aa888baaadfc5da0950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_119984833fa0ddef66644567b91fb17e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_6af955457433d8c24f784f8cd0f61718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_6698dc2a05f4f401ad7836a1f28fd141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_a8833f9847ba5cdbfe0094ab4c3ebb3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_cbc09e69b5772d8cfe01418d2c01aeeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_5f64131535a1033ecd32cca059ee20ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_76300d0557d5b563ec0b8b30c5fee9a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_955133d1419bde76f00ab8b7f84c8580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_4016c205a75ec1d13f831bc1b2305afc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e5ea9c-b309-5189-abd4-40dad8dde251/c5e5ea9c-b309-5189-abd4-40dad8dde251_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/a7/0ea77fe0cbdb1ec22a41a00f59c6ee78/pa/KY20134_79f47a940aa35ac8ec4ab8723641255c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2024}
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY20134%27 HTTP/1.1" 200 None
2025-12-05 20:05:58 [auto1.it] INFO: Saving data for KY20134: {'created_time': 1764965158.121228, 'last_price_update_time': 1764965158.121238, 'auction_closing_time': 1765038087.0}
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KY20134') HTTP/1.1" 204 0
2025-12-05 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_083f01b6f82400a0f0dbefb7e9c84e6a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3626350>
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_8d715ead3c21e58fa5ea0046969af0ee.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_8d715ead3c21e58fa5ea0046969af0ee.jpg saved to cache
2025-12-05 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT46123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae053e810>
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F01%252Fb10123783281dc1adb90afd600ff903f%252Fpa%252FSS94947_083f01b6f82400a0f0dbefb7e9c84e6a.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_083f01b6f82400a0f0dbefb7e9c84e6a.jpg saved to cache
2025-12-05 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 40291716-916d-53f4-b299-039a889d448a
2025-12-05 20:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40291716-916d-53f4-b299-039a889d448a, skipping ID generation
2025-12-05 20:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40291716-916d-53f4-b299-039a889d448a with scrape type 1
2025-12-05 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40291716-916d-53f4-b299-039a889d448a from tracking dictionaries
2025-12-05 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40291716-916d-53f4-b299-039a889d448a sending to next pipeline
2025-12-05 20:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40291716-916d-53f4-b299-039a889d448a, identifier: SS94947
2025-12-05 20:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40291716-916d-53f4-b299-039a889d448a with identifier: SS94947
2025-12-05 20:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40291716-916d-53f4-b299-039a889d448a with identifier: SS94947
2025-12-05 20:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152189 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152189
2025-12-05 20:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 40291716-916d-53f4-b299-039a889d448a spider: auto1.it
2025-12-05 20:05:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 40291716-916d-53f4-b299-039a889d448a due to rule: high_mileage_for_country.json, error: 152189 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152189
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 250,
 'expiration_date': '2025-12-06T16:43:42Z',
 'fuel_type': 'petrol',
 'id': '40291716-916d-53f4-b299-039a889d448a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS94947',
 'listing': 'auction',
 'location': 'IT, Rozzano',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 152189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3582204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_528ff996c267a671bccbe993d42c33fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3552114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_0b8e9ba88e6fe8131e0f53e1210d2a3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3361239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_83ae9e135a061a2ace34bf26fe51e091.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3161391,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_ee2067ef0943c89ceca20948d8cb8c6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3412510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_3e718e2cc260f265065428908b4d3fd7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3625438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_a7484d86ba082b8499fce22cea32db54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_72730b26ecb3ab5fd8d85d9e8721a8b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_c58d35db68dc28117b80f508b495dd6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_6fc6ec0590c1cb1f601f69fecf86db94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_490f3eb08ce3cf5e10940cdbf93a25ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_b21b56818f98f917b2724eff62d3d7a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3163418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_083f01b6f82400a0f0dbefb7e9c84e6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_4952face1ca972f524efc646805aa7cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3160512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_8d715ead3c21e58fa5ea0046969af0ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40291716-916d-53f4-b299-039a889d448a/40291716-916d-53f4-b299-039a889d448a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/01/b10123783281dc1adb90afd600ff903f/pa/SS94947_9f785ac816ee614e2b5cf42cb7cd077d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 25t R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2020}
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2025-12-05 20:05:59 [auto1.it] INFO: Saving data for SS94947: {'created_time': 1764965159.233699, 'last_price_update_time': 1764965159.233708, 'auction_closing_time': 1765039422.0}
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS94947') HTTP/1.1" 204 0
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_aa30670cb659fc0deae75cc14c862a86.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW43217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU15302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW02241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN60892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV75173/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_d48542d2f129edad34692726df833f16.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT73066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a5ead5d41b3093f366aaa20ab3e3020f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae055a550>
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_aa30670cb659fc0deae75cc14c862a86.jpg') HTTP/1.1" 204 0
2025-12-05 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_aa30670cb659fc0deae75cc14c862a86.jpg saved to cache
2025-12-05 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY28002> (referer: https://www.auto1.com/v1/car-details-view/LY28002/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37e19d0>
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fb5%252Fb1b5b482447be7d22a6f21a4e6cffb07%252Fpa%252FUF60183_d48542d2f129edad34692726df833f16.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_d48542d2f129edad34692726df833f16.jpg saved to cache
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b658e59f-346c-568c-a38d-54928cf26c45
2025-12-05 20:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b658e59f-346c-568c-a38d-54928cf26c45, skipping ID generation
2025-12-05 20:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b658e59f-346c-568c-a38d-54928cf26c45 with scrape type 1
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b658e59f-346c-568c-a38d-54928cf26c45 from tracking dictionaries
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b658e59f-346c-568c-a38d-54928cf26c45 sending to next pipeline
2025-12-05 20:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b658e59f-346c-568c-a38d-54928cf26c45, identifier: UF60183
2025-12-05 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad372a6d0>
2025-12-05 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F53%252F0d536171925d6bbf4ab483e511f5dc1d%252Fpa%252FTK25750_a5ead5d41b3093f366aaa20ab3e3020f.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a5ead5d41b3093f366aaa20ab3e3020f.jpg saved to cache
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c
2025-12-05 20:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c, skipping ID generation
2025-12-05 20:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c with scrape type 1
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c from tracking dictionaries
2025-12-05 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c sending to next pipeline
2025-12-05 20:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c, identifier: TK25750
2025-12-05 20:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b658e59f-346c-568c-a38d-54928cf26c45 with identifier: UF60183
2025-12-05 20:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b658e59f-346c-568c-a38d-54928cf26c45 with identifier: UF60183
2025-12-05 20:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b658e59f-346c-568c-a38d-54928cf26c45 with identifier: UF60183 to the API
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_d48542d2f129edad34692726df833f16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:21:34Z',
 'fuel_type': 'petrol',
 'id': 'b658e59f-346c-568c-a38d-54928cf26c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF60183',
 'listing': 'auction',
 'location': 'IT, Segrate',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 16174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5e63c7ed077a6b28f078e7cfb5be356b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_4b0fbe7111f12106741f53ff4d211cd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034922,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_d48542d2f129edad34692726df833f16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_255c0bb1a31682c6c7705e40e0b13ab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5db70df70d8fbace303056ef71db0d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_af4667159361585e3f87fe30f030243c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5f22d2c6fd1620c0cfc1db796f22e365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a9c89f1f8fc9420c070725bba3f3cffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3143794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_a74c80df778bcbe90287bc2c3fb57592.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_567a657d4b906fbc2bce4500e6db40ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2529435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_8fe3b220c4afd229ffcc2b693e7d5c95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2386947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_5fa42385cd33b27ce59eaf152fbed30f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_882b1ac6de4f3cd1044f93bc17833ea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1e7e4d56d47f7d1555f038156c0aa9d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b658e59f-346c-568c-a38d-54928cf26c45/b658e59f-346c-568c-a38d-54928cf26c45_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/b5/b1b5b482447be7d22a6f21a4e6cffb07/pa/UF60183_1ff44ade9d455a111c0819a726e39f50.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Altitude',
 'transmission': 'manual',
 'trim': 'Altitude',
 'year': 2023}
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF60183%27 HTTP/1.1" 200 None
2025-12-05 20:06:01 [auto1.it] INFO: Saving data for UF60183: {'created_time': 1764965161.128926, 'last_price_update_time': 1764965161.128939, 'auction_closing_time': 1765038094.0}
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UF60183') HTTP/1.1" 204 0
2025-12-05 20:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c with identifier: TK25750
2025-12-05 20:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c with identifier: TK25750
2025-12-05 20:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c with identifier: TK25750 to the API
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a5ead5d41b3093f366aaa20ab3e3020f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:22:25Z',
 'fuel_type': 'petrol',
 'id': '97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK25750',
 'listing': 'auction',
 'location': 'IT, Carini',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 57344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_74cc171eec8ff1ee234d33c3cbbe6653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a5ead5d41b3093f366aaa20ab3e3020f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_aa30670cb659fc0deae75cc14c862a86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_a97d3aafe2fb902fee114d0f7c2c6a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_bb5618e5384b8e10bccaa46b18131d97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_81aaf1e6f8a7c71e092d307fffd9d3b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2267734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_7c32d3f661f8d29d39b70595ca3c8a66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_3f75cee9acd1de20a56f065fde74a81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_d251c58efbc5dbcdd039f60abcb42614.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2127064,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2bb6d122de69ac572db311fe9675e013.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_c7390bcfa4a43994fda9931511d68bd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2676885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_2fe220a3fb55a1516ce20ba149b85eb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_5d18faaed2a510b2b010494997fddcd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_308ba1d484ca63a86b1c75f285a2e8e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c/97bec396-0cf4-5cf0-aa2f-5a2c5c465d6c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/53/0d536171925d6bbf4ab483e511f5dc1d/pa/TK25750_b6b3feaee5a165e5b03ef37d6d40593a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.4 TGDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK25750%27 HTTP/1.1" 200 None
2025-12-05 20:06:01 [auto1.it] INFO: Saving data for TK25750: {'created_time': 1764965161.56733, 'last_price_update_time': 1764965161.567342, 'auction_closing_time': 1765038145.0}
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TK25750') HTTP/1.1" 204 0
2025-12-05 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH40946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b1c8b5c-f352-50ad-99a2-199787b20f1d with identifier: LY28002
2025-12-05 20:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b1c8b5c-f352-50ad-99a2-199787b20f1d with scrape type 2
2025-12-05 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b1c8b5c-f352-50ad-99a2-199787b20f1d with scrape type 2
2025-12-05 20:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b1c8b5c-f352-50ad-99a2-199787b20f1d, identifier: LY28002
2025-12-05 20:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b1c8b5c-f352-50ad-99a2-199787b20f1d with identifier: LY28002
2025-12-05 20:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b1c8b5c-f352-50ad-99a2-199787b20f1d with identifier: LY28002
2025-12-05 20:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b1c8b5c-f352-50ad-99a2-199787b20f1d with identifier: LY28002 to the API
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY28002>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2025-12-06T16:35:44Z',
 'fuel_type': 'diesel',
 'id': '7b1c8b5c-f352-50ad-99a2-199787b20f1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY28002',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 124939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY28002%27 HTTP/1.1" 200 None
2025-12-05 20:06:02 [auto1.it] INFO: Saving data for LY28002: {'auction_closing_time': 1765038944.0, 'created_time': 1764237774.193756, 'last_price_update_time': 1764965162.050558}
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY28002') HTTP/1.1" 204 0
2025-12-05 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX36861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK31902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP11759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP08854> (referer: https://www.auto1.com/v1/car-details-view/BP08854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ10581> (referer: https://www.auto1.com/v1/car-details-view/BZ10581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8475fa22-9292-5011-b64a-f5ad010157b8 with identifier: BP08854
2025-12-05 20:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8475fa22-9292-5011-b64a-f5ad010157b8 with scrape type 2
2025-12-05 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8475fa22-9292-5011-b64a-f5ad010157b8 with scrape type 2
2025-12-05 20:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8475fa22-9292-5011-b64a-f5ad010157b8, identifier: BP08854
2025-12-05 20:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8475fa22-9292-5011-b64a-f5ad010157b8 with identifier: BP08854
2025-12-05 20:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8475fa22-9292-5011-b64a-f5ad010157b8 with identifier: BP08854
2025-12-05 20:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190542 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190542
2025-12-05 20:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8475fa22-9292-5011-b64a-f5ad010157b8 spider: auto1.it
2025-12-05 20:06:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8475fa22-9292-5011-b64a-f5ad010157b8 due to rule: high_mileage_for_country.json, error: 190542 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190542
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:26:19Z',
 'fuel_type': 'diesel',
 'id': '8475fa22-9292-5011-b64a-f5ad010157b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP08854',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 190542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2019}
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08854%27 HTTP/1.1" 200 None
2025-12-05 20:06:02 [auto1.it] INFO: Saving data for BP08854: {'auction_closing_time': 1765038379.0, 'created_time': 1761163247.156918, 'last_price_update_time': 1764965162.956127}
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP08854') HTTP/1.1" 204 0
2025-12-05 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM38721> (referer: https://www.auto1.com/v1/car-details-view/EM38721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44997af8-b2bd-5dca-8388-4e2fc9e3ae0b with identifier: BZ10581
2025-12-05 20:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44997af8-b2bd-5dca-8388-4e2fc9e3ae0b with scrape type 2
2025-12-05 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44997af8-b2bd-5dca-8388-4e2fc9e3ae0b with scrape type 2
2025-12-05 20:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 44997af8-b2bd-5dca-8388-4e2fc9e3ae0b, identifier: BZ10581
2025-12-05 20:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 44997af8-b2bd-5dca-8388-4e2fc9e3ae0b with identifier: BZ10581
2025-12-05 20:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 44997af8-b2bd-5dca-8388-4e2fc9e3ae0b with identifier: BZ10581
2025-12-05 20:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 44997af8-b2bd-5dca-8388-4e2fc9e3ae0b with identifier: BZ10581 to the API
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BZ10581>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:07:25Z',
 'fuel_type': 'petrol',
 'id': '44997af8-b2bd-5dca-8388-4e2fc9e3ae0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ10581',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 19223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 TGDI N Line',
 'transmission': 'manual',
 'trim': 'N Line',
 'year': 2023}
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ10581%27 HTTP/1.1" 200 None
2025-12-05 20:06:03 [auto1.it] INFO: Saving data for BZ10581: {'auction_closing_time': 1765037245.0, 'created_time': 1761163516.87737, 'last_price_update_time': 1764965163.410421}
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BZ10581') HTTP/1.1" 204 0
2025-12-05 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB36220> (referer: https://www.auto1.com/v1/car-details-view/FB36220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK85340> (referer: https://www.auto1.com/v1/car-details-view/DK85340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL85542> (referer: https://www.auto1.com/v1/car-details-view/AL85542/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS63299> (referer: https://www.auto1.com/v1/car-details-view/HS63299/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49248d2-d1eb-5ef3-9e01-321bb75728dc with identifier: EM38721
2025-12-05 20:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49248d2-d1eb-5ef3-9e01-321bb75728dc with scrape type 2
2025-12-05 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d49248d2-d1eb-5ef3-9e01-321bb75728dc with scrape type 2
2025-12-05 20:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d49248d2-d1eb-5ef3-9e01-321bb75728dc, identifier: EM38721
2025-12-05 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d49248d2-d1eb-5ef3-9e01-321bb75728dc with identifier: EM38721
2025-12-05 20:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d49248d2-d1eb-5ef3-9e01-321bb75728dc with identifier: EM38721
2025-12-05 20:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d49248d2-d1eb-5ef3-9e01-321bb75728dc with identifier: EM38721 to the API
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM38721>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 317,
 'expiration_date': '2025-12-06T16:59:33Z',
 'fuel_type': 'hybrid',
 'id': 'd49248d2-d1eb-5ef3-9e01-321bb75728dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM38721',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'DR',
 'model': 'DR 6.0',
 'odometer': 22383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 6.0 1.5 Plug-in Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM38721%27 HTTP/1.1" 200 None
2025-12-05 20:06:03 [auto1.it] INFO: Saving data for EM38721: {'auction_closing_time': 1765040373.0, 'created_time': 1760608938.84964, 'last_price_update_time': 1764965163.898384}
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EM38721') HTTP/1.1" 204 0
2025-12-05 20:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 390584de-c2bd-5b56-9b36-e7a72f707715 with identifier: FB36220
2025-12-05 20:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 390584de-c2bd-5b56-9b36-e7a72f707715 with scrape type 1
2025-12-05 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 390584de-c2bd-5b56-9b36-e7a72f707715
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_666c3edd8be71e708b9d1b28e8398e4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_666c3edd8be71e708b9d1b28e8398e4c.jpg already downloaded
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_8087a14293bbfc612d58b2c3ec138907.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_8087a14293bbfc612d58b2c3ec138907.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_db7e97167c9ea97c6af751ffb52488e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_db7e97167c9ea97c6af751ffb52488e5.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_c2efa2ba08f9f754096e4457cf118c43.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_c2efa2ba08f9f754096e4457cf118c43.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_b53900689a1493c0b46fb336abe3243f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_b53900689a1493c0b46fb336abe3243f.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_c3f4de2d47bbe5d9a1cc83053f2aefeb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_c3f4de2d47bbe5d9a1cc83053f2aefeb.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_904b18adaae567959e8d55041834e851.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_904b18adaae567959e8d55041834e851.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_29005d2c631ea488c532652b1a29bd9a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_29005d2c631ea488c532652b1a29bd9a.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_4254f843778abde7c4e144a6dc174502.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_4254f843778abde7c4e144a6dc174502.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_abf9dba039876d943d45aea41b7e4828.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_abf9dba039876d943d45aea41b7e4828.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_90f9f4c10abe61f037a202357773a58f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_90f9f4c10abe61f037a202357773a58f.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_0dedbfdc8edc3682254bf7cba5d78d48.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_0dedbfdc8edc3682254bf7cba5d78d48.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_eb38148ddcffba6b300185cf7fbca4ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_eb38148ddcffba6b300185cf7fbca4ca.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_d07a54856ca45e46ae7fb4e51e3f5460.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_d07a54856ca45e46ae7fb4e51e3f5460.jpg already downloaded
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fe6%252F13e668ae62df1b75ccd620f1f2b5ffed%252Fpa%252FFB36220_66c765e01f431a500331aad91f14d615.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_66c765e01f431a500331aad91f14d615.jpg already downloaded
2025-12-05 20:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 390584de-c2bd-5b56-9b36-e7a72f707715, identifier: FB36220
2025-12-05 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33dfdce2-8d65-53e0-a825-60075e0367bc with identifier: DK85340
2025-12-05 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33dfdce2-8d65-53e0-a825-60075e0367bc with scrape type 2
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33dfdce2-8d65-53e0-a825-60075e0367bc with scrape type 2
2025-12-05 20:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33dfdce2-8d65-53e0-a825-60075e0367bc, identifier: DK85340
2025-12-05 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2655fde1-fb33-541a-b909-152c2ebd9a10 with identifier: AL85542
2025-12-05 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2655fde1-fb33-541a-b909-152c2ebd9a10 with scrape type 2
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2655fde1-fb33-541a-b909-152c2ebd9a10 with scrape type 2
2025-12-05 20:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2655fde1-fb33-541a-b909-152c2ebd9a10, identifier: AL85542
2025-12-05 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a4ec63-aef6-5be5-b07c-a53b45badbe5 with identifier: HS63299
2025-12-05 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5 with scrape type 1
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_e5db9d9361d9b47eaa0ac68a4dd8523a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e5db9d9361d9b47eaa0ac68a4dd8523a.jpg not downloaded yet
2025-12-05 20:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 390584de-c2bd-5b56-9b36-e7a72f707715 with identifier: FB36220
2025-12-05 20:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 390584de-c2bd-5b56-9b36-e7a72f707715 with identifier: FB36220
2025-12-05 20:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 390584de-c2bd-5b56-9b36-e7a72f707715 with identifier: FB36220 to the API
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FB36220>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.1L',
 'engine_horse_power': 85,
 'expiration_date': '2025-12-06T16:19:38Z',
 'fuel_type': 'petrol',
 'id': '390584de-c2bd-5b56-9b36-e7a72f707715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB36220',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 135147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_666c3edd8be71e708b9d1b28e8398e4c.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_8087a14293bbfc612d58b2c3ec138907.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_db7e97167c9ea97c6af751ffb52488e5.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_c2efa2ba08f9f754096e4457cf118c43.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_b53900689a1493c0b46fb336abe3243f.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_c3f4de2d47bbe5d9a1cc83053f2aefeb.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_904b18adaae567959e8d55041834e851.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_29005d2c631ea488c532652b1a29bd9a.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_4254f843778abde7c4e144a6dc174502.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_abf9dba039876d943d45aea41b7e4828.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_90f9f4c10abe61f037a202357773a58f.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_0dedbfdc8edc3682254bf7cba5d78d48.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_eb38148ddcffba6b300185cf7fbca4ca.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_d07a54856ca45e46ae7fb4e51e3f5460.jpg',
                'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_66c765e01f431a500331aad91f14d615.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_666c3edd8be71e708b9d1b28e8398e4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_8087a14293bbfc612d58b2c3ec138907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_db7e97167c9ea97c6af751ffb52488e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_c2efa2ba08f9f754096e4457cf118c43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_b53900689a1493c0b46fb336abe3243f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_c3f4de2d47bbe5d9a1cc83053f2aefeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_904b18adaae567959e8d55041834e851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_29005d2c631ea488c532652b1a29bd9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_4254f843778abde7c4e144a6dc174502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_abf9dba039876d943d45aea41b7e4828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_90f9f4c10abe61f037a202357773a58f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_0dedbfdc8edc3682254bf7cba5d78d48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_eb38148ddcffba6b300185cf7fbca4ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_d07a54856ca45e46ae7fb4e51e3f5460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_390584de-c2bd-5b56-9b36-e7a72f707715/390584de-c2bd-5b56-9b36-e7a72f707715_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/e6/13e668ae62df1b75ccd620f1f2b5ffed/pa/FB36220_66c765e01f431a500331aad91f14d615.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB36220%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [auto1.it] INFO: Saving data for FB36220: {'created_time': 1764965165.036959, 'last_price_update_time': 1764965165.036968, 'auction_closing_time': 1765037978.0}
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB36220') HTTP/1.1" 204 0
2025-12-05 20:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33dfdce2-8d65-53e0-a825-60075e0367bc with identifier: DK85340
2025-12-05 20:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33dfdce2-8d65-53e0-a825-60075e0367bc with identifier: DK85340
2025-12-05 20:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33dfdce2-8d65-53e0-a825-60075e0367bc with identifier: DK85340 to the API
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DK85340>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:29:37Z',
 'fuel_type': 'petrol',
 'id': '33dfdce2-8d65-53e0-a825-60075e0367bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK85340',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 81987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK85340%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [auto1.it] INFO: Saving data for DK85340: {'auction_closing_time': 1765038577.0, 'created_time': 1764360416.569679, 'last_price_update_time': 1764965165.368796}
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK85340') HTTP/1.1" 204 0
2025-12-05 20:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2655fde1-fb33-541a-b909-152c2ebd9a10 with identifier: AL85542
2025-12-05 20:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2655fde1-fb33-541a-b909-152c2ebd9a10 with identifier: AL85542
2025-12-05 20:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2655fde1-fb33-541a-b909-152c2ebd9a10 with identifier: AL85542 to the API
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL85542>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2025-12-06T16:25:54Z',
 'fuel_type': 'hybrid',
 'id': '2655fde1-fb33-541a-b909-152c2ebd9a10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL85542',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 43300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL85542%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [auto1.it] INFO: Saving data for AL85542: {'auction_closing_time': 1765038354.0, 'created_time': 1758571373.174109, 'last_price_update_time': 1764965165.709568}
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL85542') HTTP/1.1" 204 0
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_945e068e29f2bf18a4e46501a0938ee4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_945e068e29f2bf18a4e46501a0938ee4.jpg not downloaded yet
2025-12-05 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV75173> (referer: https://www.auto1.com/v1/car-details-view/MV75173/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN60892> (referer: https://www.auto1.com/v1/car-details-view/JN60892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_65951bfdf5c2d64c71937ce28324766f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_65951bfdf5c2d64c71937ce28324766f.jpg not downloaded yet
2025-12-05 20:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_29b4ac650e2888e957a292208c714f13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_29b4ac650e2888e957a292208c714f13.jpg not downloaded yet
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_c053fc084300830a3df614666c835c66.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c053fc084300830a3df614666c835c66.jpg not downloaded yet
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_88ede3a2bcbd592d5e34fa81e56d78bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_88ede3a2bcbd592d5e34fa81e56d78bc.jpg not downloaded yet
2025-12-05 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26661868-28b6-5b47-8209-0d88c8483472 with identifier: MV75173
2025-12-05 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26661868-28b6-5b47-8209-0d88c8483472 with scrape type 1
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 26661868-28b6-5b47-8209-0d88c8483472
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_bf43ff9dbb8c667cd85f25931964c435.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_bf43ff9dbb8c667cd85f25931964c435.jpg already downloaded
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_76ba6f32f609b7f49a6a7d237ce932af.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_76ba6f32f609b7f49a6a7d237ce932af.jpg already downloaded
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_1f44a29eddb586816687f81ad42461b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_1f44a29eddb586816687f81ad42461b4.jpg already downloaded
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_b69100142af28bd4eb70dbbf26288de9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_b69100142af28bd4eb70dbbf26288de9.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_eb8e00727e3a614c5ea8831929f3427a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_eb8e00727e3a614c5ea8831929f3427a.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_35a6fe411813c30d7c2711aec897f876.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_35a6fe411813c30d7c2711aec897f876.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_8f7ce5ec20f153f1836782d8c2c86b5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_8f7ce5ec20f153f1836782d8c2c86b5f.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_7f38c31e2124249582f0e0cd417dabfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_7f38c31e2124249582f0e0cd417dabfa.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_5716987ac905dfc5019d3f68dc80b791.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_5716987ac905dfc5019d3f68dc80b791.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_2d20fe745e56defdc9d9f3923adaa5cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_2d20fe745e56defdc9d9f3923adaa5cd.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_cd328c96b6923519b30a1b336f8aaaad.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_cd328c96b6923519b30a1b336f8aaaad.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_c964aa5a15ef73f01fac866e44651093.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_c964aa5a15ef73f01fac866e44651093.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_dd7f211204e6071d96a87ed4f9e6a559.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_dd7f211204e6071d96a87ed4f9e6a559.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_7db5baea8e3888ab6384defdb7c74447.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_7db5baea8e3888ab6384defdb7c74447.jpg already downloaded
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F77%252F9f77d192f20725caad72d5f7307ac941%252Fpa%252FMV75173_f44c718d75744098c50a82d9c523185d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_f44c718d75744098c50a82d9c523185d.jpg already downloaded
2025-12-05 20:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26661868-28b6-5b47-8209-0d88c8483472, identifier: MV75173
2025-12-05 20:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 796a5f1c-0745-5fc7-b14a-c60e2abd24ff with identifier: JN60892
2025-12-05 20:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796a5f1c-0745-5fc7-b14a-c60e2abd24ff with scrape type 2
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 796a5f1c-0745-5fc7-b14a-c60e2abd24ff with scrape type 2
2025-12-05 20:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 796a5f1c-0745-5fc7-b14a-c60e2abd24ff, identifier: JN60892
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_428d26383b65e1b209cd997502972602.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_428d26383b65e1b209cd997502972602.jpg not downloaded yet
2025-12-05 20:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26661868-28b6-5b47-8209-0d88c8483472 with identifier: MV75173
2025-12-05 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26661868-28b6-5b47-8209-0d88c8483472 with identifier: MV75173
2025-12-05 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145611 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145611
2025-12-05 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 26661868-28b6-5b47-8209-0d88c8483472 spider: auto1.it
2025-12-05 20:06:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 26661868-28b6-5b47-8209-0d88c8483472 due to rule: high_mileage_for_make.json, error: 145611 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145611
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:59:44Z',
 'fuel_type': 'diesel',
 'id': '26661868-28b6-5b47-8209-0d88c8483472',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV75173',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 145611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_bf43ff9dbb8c667cd85f25931964c435.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_76ba6f32f609b7f49a6a7d237ce932af.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_1f44a29eddb586816687f81ad42461b4.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_b69100142af28bd4eb70dbbf26288de9.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_eb8e00727e3a614c5ea8831929f3427a.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_35a6fe411813c30d7c2711aec897f876.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_8f7ce5ec20f153f1836782d8c2c86b5f.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_7f38c31e2124249582f0e0cd417dabfa.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_5716987ac905dfc5019d3f68dc80b791.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_2d20fe745e56defdc9d9f3923adaa5cd.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_cd328c96b6923519b30a1b336f8aaaad.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_c964aa5a15ef73f01fac866e44651093.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_dd7f211204e6071d96a87ed4f9e6a559.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_7db5baea8e3888ab6384defdb7c74447.jpg',
                'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_f44c718d75744098c50a82d9c523185d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_bf43ff9dbb8c667cd85f25931964c435.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_76ba6f32f609b7f49a6a7d237ce932af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_1f44a29eddb586816687f81ad42461b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_b69100142af28bd4eb70dbbf26288de9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_eb8e00727e3a614c5ea8831929f3427a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_35a6fe411813c30d7c2711aec897f876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_8f7ce5ec20f153f1836782d8c2c86b5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_7f38c31e2124249582f0e0cd417dabfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_5716987ac905dfc5019d3f68dc80b791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_2d20fe745e56defdc9d9f3923adaa5cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_cd328c96b6923519b30a1b336f8aaaad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_c964aa5a15ef73f01fac866e44651093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_dd7f211204e6071d96a87ed4f9e6a559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_7db5baea8e3888ab6384defdb7c74447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26661868-28b6-5b47-8209-0d88c8483472/26661868-28b6-5b47-8209-0d88c8483472_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/77/9f77d192f20725caad72d5f7307ac941/pa/MV75173_f44c718d75744098c50a82d9c523185d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2017}
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV75173%27 HTTP/1.1" 200 None
2025-12-05 20:06:06 [auto1.it] INFO: Saving data for MV75173: {'created_time': 1764965166.715503, 'last_price_update_time': 1764965166.715516, 'auction_closing_time': 1765040384.0}
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MV75173') HTTP/1.1" 204 0
2025-12-05 20:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 796a5f1c-0745-5fc7-b14a-c60e2abd24ff with identifier: JN60892
2025-12-05 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 796a5f1c-0745-5fc7-b14a-c60e2abd24ff with identifier: JN60892
2025-12-05 20:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 796a5f1c-0745-5fc7-b14a-c60e2abd24ff with identifier: JN60892 to the API
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN60892>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:10:03Z',
 'fuel_type': 'petrol',
 'id': '796a5f1c-0745-5fc7-b14a-c60e2abd24ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN60892',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 66341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN60892%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [auto1.it] INFO: Saving data for JN60892: {'auction_closing_time': 1765037403.0, 'created_time': 1762891644.603575, 'last_price_update_time': 1764965167.083034}
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN60892') HTTP/1.1" 204 0
2025-12-05 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e5db9d9361d9b47eaa0ac68a4dd8523a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW02241> (referer: https://www.auto1.com/v1/car-details-view/YW02241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_e317a92494a74f53c038ecf7aa50b2c6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e317a92494a74f53c038ecf7aa50b2c6.jpg not downloaded yet
2025-12-05 20:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW43217> (referer: https://www.auto1.com/v1/car-details-view/MW43217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH40946> (referer: https://www.auto1.com/v1/car-details-view/ZH40946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT46123> (referer: https://www.auto1.com/v1/car-details-view/XT46123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_38cfa5f5adcd237a3871aac1613a0dc6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_38cfa5f5adcd237a3871aac1613a0dc6.jpg not downloaded yet
2025-12-05 20:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_5d87a0e7cd6edd856510813c9cf5a3e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d87a0e7cd6edd856510813c9cf5a3e6.jpg not downloaded yet
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_9c057f8951fd4d64a3b5f3a1cfda48ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_9c057f8951fd4d64a3b5f3a1cfda48ba.jpg not downloaded yet
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_07502b022c3654bd1f94a9ef7018c903.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_07502b022c3654bd1f94a9ef7018c903.jpg not downloaded yet
2025-12-05 20:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0154d90>
2025-12-05 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_e5db9d9361d9b47eaa0ac68a4dd8523a.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e5db9d9361d9b47eaa0ac68a4dd8523a.jpg saved to cache
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f7b3a0-8a45-50d4-98af-41991d8c4d62 with identifier: YW02241
2025-12-05 20:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f7b3a0-8a45-50d4-98af-41991d8c4d62 with scrape type 2
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1f7b3a0-8a45-50d4-98af-41991d8c4d62 with scrape type 2
2025-12-05 20:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1f7b3a0-8a45-50d4-98af-41991d8c4d62, identifier: YW02241
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_39d92ad0e9788810f0034f915df1821a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_39d92ad0e9788810f0034f915df1821a.jpg not downloaded yet
2025-12-05 20:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1f7b3a0-8a45-50d4-98af-41991d8c4d62 with identifier: YW02241
2025-12-05 20:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1f7b3a0-8a45-50d4-98af-41991d8c4d62 with identifier: YW02241
2025-12-05 20:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1f7b3a0-8a45-50d4-98af-41991d8c4d62 with identifier: YW02241 to the API
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW02241>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:50:49Z',
 'fuel_type': 'diesel',
 'id': 'f1f7b3a0-8a45-50d4-98af-41991d8c4d62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW02241',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 133956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive 25d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2018}
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW02241%27 HTTP/1.1" 200 None
2025-12-05 20:06:07 [auto1.it] INFO: Saving data for YW02241: {'auction_closing_time': 1765039849.0, 'created_time': 1762287261.876117, 'last_price_update_time': 1764965167.955329}
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW02241') HTTP/1.1" 204 0
2025-12-05 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_88ede3a2bcbd592d5e34fa81e56d78bc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_938255a70cdfa8ff38b8990dd0f41fba.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_938255a70cdfa8ff38b8990dd0f41fba.jpg not downloaded yet
2025-12-05 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf151b7-4391-5568-acb9-041518a8171e with identifier: MW43217
2025-12-05 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf151b7-4391-5568-acb9-041518a8171e with scrape type 1
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_b0f912ed9b220dfd42a7fc61b223311a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_b0f912ed9b220dfd42a7fc61b223311a.jpg not downloaded yet
2025-12-05 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db929b3c-038f-5cb0-ad78-1a6730620cf2 with identifier: ZH40946
2025-12-05 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db929b3c-038f-5cb0-ad78-1a6730620cf2 with scrape type 1
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_9f1cb02ebd24ed459a628ef719c416bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_9f1cb02ebd24ed459a628ef719c416bb.jpg not downloaded yet
2025-12-05 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 with identifier: XT46123
2025-12-05 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 with scrape type 1
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_07af4880d501b3cc673e79184e661303.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_07af4880d501b3cc673e79184e661303.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_c6efea5f0472c347e66dfe0a8b866875.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c6efea5f0472c347e66dfe0a8b866875.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_863fb59f133405b509132f36736d8fcd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_863fb59f133405b509132f36736d8fcd.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_d79a36dee90db84bfdcd35705a2ff735.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d79a36dee90db84bfdcd35705a2ff735.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_c6d1a68123c0ae4d820fe85f88be72bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c6d1a68123c0ae4d820fe85f88be72bc.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_5d6031208fac93a5a5ea8af5bd9e085a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d6031208fac93a5a5ea8af5bd9e085a.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_a99fe03e93b21f855c8b1d60d99b374b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a99fe03e93b21f855c8b1d60d99b374b.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_5d5e0b2b5a520de7cf854f1983d8ae34.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_5d5e0b2b5a520de7cf854f1983d8ae34.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_4202e3bbb465256b660514557769f928.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_4202e3bbb465256b660514557769f928.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_20d297d8b7db467d6f79b4173a51cfa4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_20d297d8b7db467d6f79b4173a51cfa4.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_18b8e092ba43faae61198acc3dc0dc5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_18b8e092ba43faae61198acc3dc0dc5b.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_96491fe8f06f45f146b6422ce82f7a01.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_96491fe8f06f45f146b6422ce82f7a01.jpg not downloaded yet
2025-12-05 20:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0436cd0>
2025-12-05 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_88ede3a2bcbd592d5e34fa81e56d78bc.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_88ede3a2bcbd592d5e34fa81e56d78bc.jpg saved to cache
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_ba605e79f90464611c785cd5f4a674eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_ba605e79f90464611c785cd5f4a674eb.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_8a0d02980a66e372dfd6b0edc4cd5de5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8a0d02980a66e372dfd6b0edc4cd5de5.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_f2b80cc7ab9145d7525da995b0e3c243.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_f2b80cc7ab9145d7525da995b0e3c243.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_a9fa7432f0b08dc3231c5a04652da915.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a9fa7432f0b08dc3231c5a04652da915.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_f9bded3e9c6900914f3139ae55cc7c99.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_f9bded3e9c6900914f3139ae55cc7c99.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_dfb6561cf2b0c992aad496cc36855d6d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_dfb6561cf2b0c992aad496cc36855d6d.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_de2cf80e67840207d946e1095d86f3e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_de2cf80e67840207d946e1095d86f3e1.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_8e45691b132179d316150ce647f0458b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8e45691b132179d316150ce647f0458b.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_3800bda0ceab20624c78f40655adb62b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_3800bda0ceab20624c78f40655adb62b.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_f83c2ae55cb9b197614a848d7c903910.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_f83c2ae55cb9b197614a848d7c903910.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_c013d9e62a892eeb32d87fc4034b3169.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c013d9e62a892eeb32d87fc4034b3169.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_aa2f83bf1a1ad26bdc162a8da5f93aea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_aa2f83bf1a1ad26bdc162a8da5f93aea.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_84589cca0c8bd9fff8daa3aa0d3fa855.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_84589cca0c8bd9fff8daa3aa0d3fa855.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_c69f51a4124aa55495b5564a65656e78.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c69f51a4124aa55495b5564a65656e78.jpg not downloaded yet
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_c904c6d8df1a23fd78430905a71b765b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c904c6d8df1a23fd78430905a71b765b.jpg not downloaded yet
2025-12-05 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK31902> (referer: https://www.auto1.com/v1/car-details-view/KK31902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_85107d4e2e95dda045b7e8a080a8bad3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_85107d4e2e95dda045b7e8a080a8bad3.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_73615b354a35b88ce880054b05e15db7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_73615b354a35b88ce880054b05e15db7.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_5e5e2b35a16af15f869feab936ebad99.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_5e5e2b35a16af15f869feab936ebad99.jpg not downloaded yet
2025-12-05 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_4c883ad045c94cc2a09374196bc8beff.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_4c883ad045c94cc2a09374196bc8beff.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_d598dd51515968bbdbea33b8424fba16.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d598dd51515968bbdbea33b8424fba16.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_e83c9ce8c5de73b877f71e9725fcca10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_e83c9ce8c5de73b877f71e9725fcca10.jpg not downloaded yet
2025-12-05 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB50732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_870f2d2882b3bab788af20b28ff00cc0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_870f2d2882b3bab788af20b28ff00cc0.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_d326e45e95922208383665f5c854ab94.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d326e45e95922208383665f5c854ab94.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_686fd9751de6a647401d896908b64f0e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_686fd9751de6a647401d896908b64f0e.jpg not downloaded yet
2025-12-05 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_945e068e29f2bf18a4e46501a0938ee4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_80273e0ecdc9ddbeb47e95e23294549a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_80273e0ecdc9ddbeb47e95e23294549a.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_b1accfb0a706e18b9d0c500eb2f7c175.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_b1accfb0a706e18b9d0c500eb2f7c175.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_d9621871195b60a7a36ae01d3fac0796.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_d9621871195b60a7a36ae01d3fac0796.jpg not downloaded yet
2025-12-05 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX36861> (referer: https://www.auto1.com/v1/car-details-view/NX36861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP11759> (referer: https://www.auto1.com/v1/car-details-view/HP11759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf72f71b-34b5-5f43-ac17-7d68a3472ddb with identifier: KK31902
2025-12-05 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf72f71b-34b5-5f43-ac17-7d68a3472ddb with scrape type 1
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item cf72f71b-34b5-5f43-ac17-7d68a3472ddb
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_b49a59c366f6a2ccd981f67375425b15.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_b49a59c366f6a2ccd981f67375425b15.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_162b4204a602532e556cc081590eee25.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_162b4204a602532e556cc081590eee25.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_12e990d0eaab4880df65756d35c7db64.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_12e990d0eaab4880df65756d35c7db64.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_2b8913fdcfde8b245d6e5b2a61a38acd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_2b8913fdcfde8b245d6e5b2a61a38acd.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_76f50d13fbdee7cc36a7e040b6e157bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_76f50d13fbdee7cc36a7e040b6e157bc.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_8ec14a183786f5100cf6aac7082a1b9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_8ec14a183786f5100cf6aac7082a1b9b.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_c0e298e65301539d88c78222b0b31e9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_c0e298e65301539d88c78222b0b31e9c.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_55cf7fda9ab05ae18bef40f49b7de8cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_55cf7fda9ab05ae18bef40f49b7de8cc.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_86837edde0bab981db061692c3f09516.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_86837edde0bab981db061692c3f09516.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_2eac1bbd925edae8c8d4b8aafd76f6ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_2eac1bbd925edae8c8d4b8aafd76f6ee.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_1d7f503b12af07126c7cf9cf0d5d94f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_1d7f503b12af07126c7cf9cf0d5d94f4.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_862ee3fcface8fa926c672354f556c72.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_862ee3fcface8fa926c672354f556c72.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_c73ceda430f1f01cac079ca66083710a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_c73ceda430f1f01cac079ca66083710a.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_580f9e598744bceced37fd238c1452af.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_580f9e598744bceced37fd238c1452af.jpg already downloaded
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fc3%252Fd0c36ca6d845532557dd78878ef12836%252Fpa%252FKK31902_4eaf2c1a7d92dcaece291c7f4aa9fc8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_4eaf2c1a7d92dcaece291c7f4aa9fc8f.jpg already downloaded
2025-12-05 20:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf72f71b-34b5-5f43-ac17-7d68a3472ddb, identifier: KK31902
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_d75a7c4a69aa7596bb24ef1312bcbcd5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_d75a7c4a69aa7596bb24ef1312bcbcd5.jpg not downloaded yet
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_a2dde4561f03eb437cf85a5aa82c99aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_a2dde4561f03eb437cf85a5aa82c99aa.jpg not downloaded yet
2025-12-05 20:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf72f71b-34b5-5f43-ac17-7d68a3472ddb with identifier: KK31902
2025-12-05 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf72f71b-34b5-5f43-ac17-7d68a3472ddb with identifier: KK31902
2025-12-05 20:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf72f71b-34b5-5f43-ac17-7d68a3472ddb with identifier: KK31902 to the API
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK31902>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 111,
 'expiration_date': '2025-12-06T16:48:41Z',
 'fuel_type': 'petrol',
 'id': 'cf72f71b-34b5-5f43-ac17-7d68a3472ddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK31902',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 70273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_b49a59c366f6a2ccd981f67375425b15.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_162b4204a602532e556cc081590eee25.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_12e990d0eaab4880df65756d35c7db64.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_2b8913fdcfde8b245d6e5b2a61a38acd.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_76f50d13fbdee7cc36a7e040b6e157bc.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_8ec14a183786f5100cf6aac7082a1b9b.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_c0e298e65301539d88c78222b0b31e9c.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_55cf7fda9ab05ae18bef40f49b7de8cc.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_86837edde0bab981db061692c3f09516.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_2eac1bbd925edae8c8d4b8aafd76f6ee.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_1d7f503b12af07126c7cf9cf0d5d94f4.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_862ee3fcface8fa926c672354f556c72.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_c73ceda430f1f01cac079ca66083710a.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_580f9e598744bceced37fd238c1452af.jpg',
                'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_4eaf2c1a7d92dcaece291c7f4aa9fc8f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_b49a59c366f6a2ccd981f67375425b15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_162b4204a602532e556cc081590eee25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_12e990d0eaab4880df65756d35c7db64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1731406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_2b8913fdcfde8b245d6e5b2a61a38acd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2234022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_76f50d13fbdee7cc36a7e040b6e157bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2307767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_8ec14a183786f5100cf6aac7082a1b9b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1883490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_c0e298e65301539d88c78222b0b31e9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_55cf7fda9ab05ae18bef40f49b7de8cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2265090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_86837edde0bab981db061692c3f09516.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1897568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_2eac1bbd925edae8c8d4b8aafd76f6ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2089953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_1d7f503b12af07126c7cf9cf0d5d94f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_862ee3fcface8fa926c672354f556c72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_c73ceda430f1f01cac079ca66083710a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2130793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_580f9e598744bceced37fd238c1452af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf72f71b-34b5-5f43-ac17-7d68a3472ddb/cf72f71b-34b5-5f43-ac17-7d68a3472ddb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/c3/d0c36ca6d845532557dd78878ef12836/pa/KK31902_4eaf2c1a7d92dcaece291c7f4aa9fc8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.0 BoosterJet Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2019}
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK31902%27 HTTP/1.1" 200 None
2025-12-05 20:06:10 [auto1.it] INFO: Saving data for KK31902: {'created_time': 1764965170.119446, 'last_price_update_time': 1764965170.119456, 'auction_closing_time': 1765039721.0}
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK31902') HTTP/1.1" 204 0
2025-12-05 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ58430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c904c6d8df1a23fd78430905a71b765b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_e83c9ce8c5de73b877f71e9725fcca10.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_cd80cbd486ee10f06115684fa164ecf3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_cd80cbd486ee10f06115684fa164ecf3.jpg not downloaded yet
2025-12-05 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT73066> (referer: https://www.auto1.com/v1/car-details-view/UT73066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae017e690>
2025-12-05 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_945e068e29f2bf18a4e46501a0938ee4.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_945e068e29f2bf18a4e46501a0938ee4.jpg saved to cache
2025-12-05 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d9b9cf7-6a3d-54a5-afd4-c179f015c650 with identifier: NX36861
2025-12-05 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d9b9cf7-6a3d-54a5-afd4-c179f015c650 with scrape type 2
2025-12-05 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d9b9cf7-6a3d-54a5-afd4-c179f015c650 with scrape type 2
2025-12-05 20:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d9b9cf7-6a3d-54a5-afd4-c179f015c650, identifier: NX36861
2025-12-05 20:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd802267-f03a-551b-8520-eb8d2a31a0b6 with identifier: HP11759
2025-12-05 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd802267-f03a-551b-8520-eb8d2a31a0b6 with scrape type 2
2025-12-05 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd802267-f03a-551b-8520-eb8d2a31a0b6 with scrape type 2
2025-12-05 20:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd802267-f03a-551b-8520-eb8d2a31a0b6, identifier: HP11759
2025-12-05 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD14180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d9b9cf7-6a3d-54a5-afd4-c179f015c650 with identifier: NX36861
2025-12-05 20:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d9b9cf7-6a3d-54a5-afd4-c179f015c650 with identifier: NX36861
2025-12-05 20:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154238 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154238
2025-12-05 20:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4d9b9cf7-6a3d-54a5-afd4-c179f015c650 spider: auto1.it
2025-12-05 20:06:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4d9b9cf7-6a3d-54a5-afd4-c179f015c650 due to rule: high_mileage_for_country.json, error: 154238 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154238
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:31:45Z',
 'fuel_type': 'diesel',
 'id': '4d9b9cf7-6a3d-54a5-afd4-c179f015c650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX36861',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 154238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Sport-Tech Q4',
 'transmission': 'automatic',
 'trim': 'Sport-Tech Q4',
 'year': 2019}
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX36861%27 HTTP/1.1" 200 None
2025-12-05 20:06:11 [auto1.it] INFO: Saving data for NX36861: {'auction_closing_time': 1765038705.0, 'created_time': 1762632161.043804, 'last_price_update_time': 1764965171.034634}
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NX36861') HTTP/1.1" 204 0
2025-12-05 20:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd802267-f03a-551b-8520-eb8d2a31a0b6 with identifier: HP11759
2025-12-05 20:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd802267-f03a-551b-8520-eb8d2a31a0b6 with identifier: HP11759
2025-12-05 20:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd802267-f03a-551b-8520-eb8d2a31a0b6 with identifier: HP11759 to the API
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HP11759>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:28:46Z',
 'fuel_type': 'diesel',
 'id': 'cd802267-f03a-551b-8520-eb8d2a31a0b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP11759',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 104906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi N-Tec',
 'transmission': 'automatic',
 'trim': 'N-Tec',
 'year': 2021}
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP11759%27 HTTP/1.1" 200 None
2025-12-05 20:06:11 [auto1.it] INFO: Saving data for HP11759: {'auction_closing_time': 1765038526.0, 'created_time': 1761040924.212097, 'last_price_update_time': 1764965171.396225}
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP11759') HTTP/1.1" 204 0
2025-12-05 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_428d26383b65e1b209cd997502972602.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_29b4ac650e2888e957a292208c714f13.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB07830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0316910>
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_c904c6d8df1a23fd78430905a71b765b.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c904c6d8df1a23fd78430905a71b765b.jpg saved to cache
2025-12-05 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3640a90>
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_e83c9ce8c5de73b877f71e9725fcca10.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_e83c9ce8c5de73b877f71e9725fcca10.jpg saved to cache
2025-12-05 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79619f7-5260-53d6-906f-b90b5de24320 with identifier: UT73066
2025-12-05 20:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79619f7-5260-53d6-906f-b90b5de24320 with scrape type 1
2025-12-05 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_c8c62f91225666386114a8c491f7efb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c8c62f91225666386114a8c491f7efb3.jpg not downloaded yet
2025-12-05 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_d9621871195b60a7a36ae01d3fac0796.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d326e45e95922208383665f5c854ab94.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_d75a7c4a69aa7596bb24ef1312bcbcd5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_d52168ed6667f6fcc678f4224b39c2f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_d52168ed6667f6fcc678f4224b39c2f8.jpg not downloaded yet
2025-12-05 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c053fc084300830a3df614666c835c66.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_515e2e92afe835e503a9955de285dc61.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_515e2e92afe835e503a9955de285dc61.jpg not downloaded yet
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e317a92494a74f53c038ecf7aa50b2c6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae037f650>
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_428d26383b65e1b209cd997502972602.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_428d26383b65e1b209cd997502972602.jpg saved to cache
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37b0310>
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_29b4ac650e2888e957a292208c714f13.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_29b4ac650e2888e957a292208c714f13.jpg saved to cache
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_f8b66932edd480218a90d698d779ecc4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_f8b66932edd480218a90d698d779ecc4.jpg not downloaded yet
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_686fd9751de6a647401d896908b64f0e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_870f2d2882b3bab788af20b28ff00cc0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_80273e0ecdc9ddbeb47e95e23294549a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_b1accfb0a706e18b9d0c500eb2f7c175.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC08182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_cd80cbd486ee10f06115684fa164ecf3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_cc9b29fa04ef0232ac2688828ef37d46.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cc9b29fa04ef0232ac2688828ef37d46.jpg not downloaded yet
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_cedee84d4aaa5717bba2100df90b60b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cedee84d4aaa5717bba2100df90b60b3.jpg not downloaded yet
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04b8f50>
2025-12-05 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_d9621871195b60a7a36ae01d3fac0796.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_d9621871195b60a7a36ae01d3fac0796.jpg saved to cache
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03957d0>
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_d326e45e95922208383665f5c854ab94.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d326e45e95922208383665f5c854ab94.jpg saved to cache
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00b4050>
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_d75a7c4a69aa7596bb24ef1312bcbcd5.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_d75a7c4a69aa7596bb24ef1312bcbcd5.jpg saved to cache
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0197750>
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_c053fc084300830a3df614666c835c66.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c053fc084300830a3df614666c835c66.jpg saved to cache
2025-12-05 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00b7750>
2025-12-05 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_e317a92494a74f53c038ecf7aa50b2c6.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e317a92494a74f53c038ecf7aa50b2c6.jpg saved to cache
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c8c62f91225666386114a8c491f7efb3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_4c883ad045c94cc2a09374196bc8beff.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_4727241ab03490fd80904c771f1ba79e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_4727241ab03490fd80904c771f1ba79e.jpg not downloaded yet
2025-12-05 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB50732> (referer: https://www.auto1.com/v1/car-details-view/LB50732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_da965309f5ca50b0189e7acfff936a34.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_da965309f5ca50b0189e7acfff936a34.jpg not downloaded yet
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad360a210>
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_686fd9751de6a647401d896908b64f0e.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_686fd9751de6a647401d896908b64f0e.jpg saved to cache
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05cb2d0>
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_870f2d2882b3bab788af20b28ff00cc0.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_870f2d2882b3bab788af20b28ff00cc0.jpg saved to cache
2025-12-05 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0310bd0>
2025-12-05 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_80273e0ecdc9ddbeb47e95e23294549a.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_80273e0ecdc9ddbeb47e95e23294549a.jpg saved to cache
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05ccbd0>
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_b1accfb0a706e18b9d0c500eb2f7c175.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_b1accfb0a706e18b9d0c500eb2f7c175.jpg saved to cache
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3608690>
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_cd80cbd486ee10f06115684fa164ecf3.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_cd80cbd486ee10f06115684fa164ecf3.jpg saved to cache
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_39d92ad0e9788810f0034f915df1821a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_280c6dc4e6469e3b989e7ea6604b55d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_280c6dc4e6469e3b989e7ea6604b55d6.jpg not downloaded yet
2025-12-05 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ58430> (referer: https://www.auto1.com/v1/car-details-view/TZ58430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_0ac09d4ae934ce2aba2d0e5a1ac927df.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_0ac09d4ae934ce2aba2d0e5a1ac927df.jpg not downloaded yet
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0395f10>
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_c8c62f91225666386114a8c491f7efb3.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c8c62f91225666386114a8c491f7efb3.jpg saved to cache
2025-12-05 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a9c10>
2025-12-05 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_4c883ad045c94cc2a09374196bc8beff.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_4c883ad045c94cc2a09374196bc8beff.jpg saved to cache
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 202bfa3e-0e99-55b7-b8ce-ff50100b06ad with identifier: LB50732
2025-12-05 20:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 202bfa3e-0e99-55b7-b8ce-ff50100b06ad with scrape type 1
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 202bfa3e-0e99-55b7-b8ce-ff50100b06ad
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_34c975a4ef16bfdcb3c8e5af877c0248.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_34c975a4ef16bfdcb3c8e5af877c0248.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_6b36b9b74934a7f4c96d9cba596a3998.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_6b36b9b74934a7f4c96d9cba596a3998.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_d8c15e06cf2f820fde6aea530fe4ebac.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_d8c15e06cf2f820fde6aea530fe4ebac.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_e14c960c95f569a5883d01edcd2bc279.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_e14c960c95f569a5883d01edcd2bc279.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_891f3025fd54cb741e9f525bdef4da6a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_891f3025fd54cb741e9f525bdef4da6a.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_c4173b7458e489b52cd0eecd0a6f6bdf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_c4173b7458e489b52cd0eecd0a6f6bdf.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_d16f3574d4c19648bce36a0ea03a947e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_d16f3574d4c19648bce36a0ea03a947e.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_899e3cc07383c78693afd7aa2beb54cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_899e3cc07383c78693afd7aa2beb54cb.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_fea6ccc83eeea9466f42933b804824c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_fea6ccc83eeea9466f42933b804824c5.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_2839ac5b610b0d82016c10a42e3ead7a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_2839ac5b610b0d82016c10a42e3ead7a.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_605d3dcc6e033dc2ae5ace78cdd9fd40.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_605d3dcc6e033dc2ae5ace78cdd9fd40.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_5f7ed99d308db3237adda69f64d08c1a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_5f7ed99d308db3237adda69f64d08c1a.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_0681966ae3aba2e214f23996924a465a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_0681966ae3aba2e214f23996924a465a.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_0fb282d7f567effbc43193395f783ef4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_0fb282d7f567effbc43193395f783ef4.jpg already downloaded
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F39%252F7c39e8a58096a299d337f1c5f4ae0b07%252Fpa%252FLB50732_e887ce71e9b1a154a9af5f4a70dd72ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_e887ce71e9b1a154a9af5f4a70dd72ea.jpg already downloaded
2025-12-05 20:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 202bfa3e-0e99-55b7-b8ce-ff50100b06ad, identifier: LB50732
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_af26bf190da1b6d4b977fe2f449947c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_af26bf190da1b6d4b977fe2f449947c7.jpg not downloaded yet
2025-12-05 20:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 202bfa3e-0e99-55b7-b8ce-ff50100b06ad with identifier: LB50732
2025-12-05 20:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 202bfa3e-0e99-55b7-b8ce-ff50100b06ad with identifier: LB50732
2025-12-05 20:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178443 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178443
2025-12-05 20:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 202bfa3e-0e99-55b7-b8ce-ff50100b06ad spider: auto1.it
2025-12-05 20:06:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 202bfa3e-0e99-55b7-b8ce-ff50100b06ad due to rule: high_mileage_for_country.json, error: 178443 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178443
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.1L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:55:28Z',
 'fuel_type': 'diesel',
 'id': '202bfa3e-0e99-55b7-b8ce-ff50100b06ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB50732',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 178443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_34c975a4ef16bfdcb3c8e5af877c0248.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_6b36b9b74934a7f4c96d9cba596a3998.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_d8c15e06cf2f820fde6aea530fe4ebac.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_e14c960c95f569a5883d01edcd2bc279.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_891f3025fd54cb741e9f525bdef4da6a.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_c4173b7458e489b52cd0eecd0a6f6bdf.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_d16f3574d4c19648bce36a0ea03a947e.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_899e3cc07383c78693afd7aa2beb54cb.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_fea6ccc83eeea9466f42933b804824c5.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_2839ac5b610b0d82016c10a42e3ead7a.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_605d3dcc6e033dc2ae5ace78cdd9fd40.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_5f7ed99d308db3237adda69f64d08c1a.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_0681966ae3aba2e214f23996924a465a.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_0fb282d7f567effbc43193395f783ef4.jpg',
                'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_e887ce71e9b1a154a9af5f4a70dd72ea.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637487,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_34c975a4ef16bfdcb3c8e5af877c0248.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_6b36b9b74934a7f4c96d9cba596a3998.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_d8c15e06cf2f820fde6aea530fe4ebac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_e14c960c95f569a5883d01edcd2bc279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_891f3025fd54cb741e9f525bdef4da6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_c4173b7458e489b52cd0eecd0a6f6bdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_d16f3574d4c19648bce36a0ea03a947e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_899e3cc07383c78693afd7aa2beb54cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_fea6ccc83eeea9466f42933b804824c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_2839ac5b610b0d82016c10a42e3ead7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_605d3dcc6e033dc2ae5ace78cdd9fd40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803119,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_5f7ed99d308db3237adda69f64d08c1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_0681966ae3aba2e214f23996924a465a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_0fb282d7f567effbc43193395f783ef4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202bfa3e-0e99-55b7-b8ce-ff50100b06ad/202bfa3e-0e99-55b7-b8ce-ff50100b06ad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/39/7c39e8a58096a299d337f1c5f4ae0b07/pa/LB50732_e887ce71e9b1a154a9af5f4a70dd72ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2020}
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50732%27 HTTP/1.1" 200 None
2025-12-05 20:06:16 [auto1.it] INFO: Saving data for LB50732: {'created_time': 1764965176.947587, 'last_price_update_time': 1764965176.947596, 'auction_closing_time': 1765040128.0}
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB50732') HTTP/1.1" 204 0
2025-12-05 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_f8b66932edd480218a90d698d779ecc4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_515e2e92afe835e503a9955de285dc61.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_d52168ed6667f6fcc678f4224b39c2f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cc9b29fa04ef0232ac2688828ef37d46.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cedee84d4aaa5717bba2100df90b60b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_5ab9363cb487800e74d2060151361934.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_5ab9363cb487800e74d2060151361934.jpg not downloaded yet
2025-12-05 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363e210>
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_39d92ad0e9788810f0034f915df1821a.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_39d92ad0e9788810f0034f915df1821a.jpg saved to cache
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430
2025-12-05 20:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20a24d4d-ffe8-54f8-9ddd-191411709da7 with scrape type 1
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_9103c9b6390ff4cfd323cefb98771380.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_9103c9b6390ff4cfd323cefb98771380.jpg not downloaded yet
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_37628edf626ccdb374f7768ad265c693.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_37628edf626ccdb374f7768ad265c693.jpg not downloaded yet
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_763eb7a2ff4fc6b8f3640c733441204f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_763eb7a2ff4fc6b8f3640c733441204f.jpg not downloaded yet
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0579f50>
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_f8b66932edd480218a90d698d779ecc4.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_f8b66932edd480218a90d698d779ecc4.jpg saved to cache
2025-12-05 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363ac10>
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_515e2e92afe835e503a9955de285dc61.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_515e2e92afe835e503a9955de285dc61.jpg saved to cache
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0558450>
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_d52168ed6667f6fcc678f4224b39c2f8.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_d52168ed6667f6fcc678f4224b39c2f8.jpg saved to cache
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37b50d0>
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_cc9b29fa04ef0232ac2688828ef37d46.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cc9b29fa04ef0232ac2688828ef37d46.jpg saved to cache
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3728550>
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_cedee84d4aaa5717bba2100df90b60b3.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cedee84d4aaa5717bba2100df90b60b3.jpg saved to cache
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_85107d4e2e95dda045b7e8a080a8bad3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_e4af53349c94f257bbfd3c47182a6297.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_e4af53349c94f257bbfd3c47182a6297.jpg not downloaded yet
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_b343d3938ae0b2917a3cc8bd30df78ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b343d3938ae0b2917a3cc8bd30df78ef.jpg not downloaded yet
2025-12-05 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_af26bf190da1b6d4b977fe2f449947c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_4727241ab03490fd80904c771f1ba79e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB07830> (referer: https://www.auto1.com/v1/car-details-view/JB07830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC08182> (referer: https://www.auto1.com/v1/car-details-view/RC08182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_280c6dc4e6469e3b989e7ea6604b55d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_c6f987ffc02a98803029a275bf5171f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c6f987ffc02a98803029a275bf5171f7.jpg not downloaded yet
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_ed82c20c07cbdfbc3ffba4120553df7d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ed82c20c07cbdfbc3ffba4120553df7d.jpg not downloaded yet
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_12d25a0e1d19aabb9a40cddd0f9210e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_12d25a0e1d19aabb9a40cddd0f9210e7.jpg not downloaded yet
2025-12-05 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_0ac09d4ae934ce2aba2d0e5a1ac927df.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_2ea2f2f089bc1576b2e870ae2045813d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_2ea2f2f089bc1576b2e870ae2045813d.jpg not downloaded yet
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370fb50>
2025-12-05 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_85107d4e2e95dda045b7e8a080a8bad3.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_85107d4e2e95dda045b7e8a080a8bad3.jpg saved to cache
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_5e5e2b35a16af15f869feab936ebad99.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_3d52a1a815026c141650a4594420e045.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3d52a1a815026c141650a4594420e045.jpg not downloaded yet
2025-12-05 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_84589cca0c8bd9fff8daa3aa0d3fa855.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04f7090>
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_af26bf190da1b6d4b977fe2f449947c7.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_af26bf190da1b6d4b977fe2f449947c7.jpg saved to cache
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04b94d0>
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_4727241ab03490fd80904c771f1ba79e.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_4727241ab03490fd80904c771f1ba79e.jpg saved to cache
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be0ceee-45b2-59d3-9367-d92274e36dde with identifier: JB07830
2025-12-05 20:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be0ceee-45b2-59d3-9367-d92274e36dde with scrape type 1
2025-12-05 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 7be0ceee-45b2-59d3-9367-d92274e36dde
2025-12-05 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_a631c418d46e21435428b561ac5d8e18.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_a631c418d46e21435428b561ac5d8e18.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_c08b6775f9a5eededbf6a2d7eb25c137.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_c08b6775f9a5eededbf6a2d7eb25c137.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_4927de07799f6561e4f8a3232b651af0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_4927de07799f6561e4f8a3232b651af0.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_0a2d54152e751cc256ed59f3a437e19d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_0a2d54152e751cc256ed59f3a437e19d.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_d68f98828a63e1fbad8713c6e4ba6bb5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_d68f98828a63e1fbad8713c6e4ba6bb5.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_6edbc9701b08f370ad1daf99e34c9fb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_6edbc9701b08f370ad1daf99e34c9fb0.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_c92b646568e36c9c18c2a9520292380b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_c92b646568e36c9c18c2a9520292380b.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_67d9c7eed96084805ac73f703f9b14b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_67d9c7eed96084805ac73f703f9b14b6.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_1ffd330dfec43d99e7dff6e866ce93b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_1ffd330dfec43d99e7dff6e866ce93b2.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_b89cc68fe5c0f7e50b8931d8140df2c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_b89cc68fe5c0f7e50b8931d8140df2c0.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_47bbac846e923262e9e00575a8fd780e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_47bbac846e923262e9e00575a8fd780e.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_d18fc8d04f95bcbc05f27711ffc3170c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_d18fc8d04f95bcbc05f27711ffc3170c.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_3ac6b3996cc210dc7c4b41602df13dcf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_3ac6b3996cc210dc7c4b41602df13dcf.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_6cae041278e3a5ed2d19e3ffc6ee8a51.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_6cae041278e3a5ed2d19e3ffc6ee8a51.jpg already downloaded
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F76%252F4376533b2a85f6e66f949f362c57d25b%252Fpa%252FJB07830_1e78896e4494c2349a9e03e8dc634745.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_1e78896e4494c2349a9e03e8dc634745.jpg already downloaded
2025-12-05 20:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7be0ceee-45b2-59d3-9367-d92274e36dde, identifier: JB07830
2025-12-05 20:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92a7915-22e0-518f-b55f-58a2e6642828 with identifier: RC08182
2025-12-05 20:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92a7915-22e0-518f-b55f-58a2e6642828 with scrape type 1
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_368c457c3464fef41b56f07853d95e26.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_368c457c3464fef41b56f07853d95e26.jpg not downloaded yet
2025-12-05 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f8c10>
2025-12-05 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_280c6dc4e6469e3b989e7ea6604b55d6.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_280c6dc4e6469e3b989e7ea6604b55d6.jpg saved to cache
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_da965309f5ca50b0189e7acfff936a34.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_ee62c10a224cc2bc645d7ce6799c6b46.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ee62c10a224cc2bc645d7ce6799c6b46.jpg not downloaded yet
2025-12-05 20:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7be0ceee-45b2-59d3-9367-d92274e36dde with identifier: JB07830
2025-12-05 20:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7be0ceee-45b2-59d3-9367-d92274e36dde with identifier: JB07830
2025-12-05 20:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158822 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158822
2025-12-05 20:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7be0ceee-45b2-59d3-9367-d92274e36dde spider: auto1.it
2025-12-05 20:06:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 7be0ceee-45b2-59d3-9367-d92274e36dde due to rule: high_mileage_for_country.json, error: 158822 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158822
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:20:45Z',
 'fuel_type': 'diesel',
 'id': '7be0ceee-45b2-59d3-9367-d92274e36dde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB07830',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 158822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_a631c418d46e21435428b561ac5d8e18.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_c08b6775f9a5eededbf6a2d7eb25c137.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_4927de07799f6561e4f8a3232b651af0.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_0a2d54152e751cc256ed59f3a437e19d.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_d68f98828a63e1fbad8713c6e4ba6bb5.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_6edbc9701b08f370ad1daf99e34c9fb0.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_c92b646568e36c9c18c2a9520292380b.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_67d9c7eed96084805ac73f703f9b14b6.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_1ffd330dfec43d99e7dff6e866ce93b2.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_b89cc68fe5c0f7e50b8931d8140df2c0.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_47bbac846e923262e9e00575a8fd780e.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_d18fc8d04f95bcbc05f27711ffc3170c.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_3ac6b3996cc210dc7c4b41602df13dcf.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_6cae041278e3a5ed2d19e3ffc6ee8a51.jpg',
                'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_1e78896e4494c2349a9e03e8dc634745.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2169025,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_a631c418d46e21435428b561ac5d8e18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2152825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_c08b6775f9a5eededbf6a2d7eb25c137.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2058397,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_4927de07799f6561e4f8a3232b651af0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2148984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_0a2d54152e751cc256ed59f3a437e19d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2210970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_d68f98828a63e1fbad8713c6e4ba6bb5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2252871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_6edbc9701b08f370ad1daf99e34c9fb0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2185133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_c92b646568e36c9c18c2a9520292380b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2233297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_67d9c7eed96084805ac73f703f9b14b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2108485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_1ffd330dfec43d99e7dff6e866ce93b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377946,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_b89cc68fe5c0f7e50b8931d8140df2c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_47bbac846e923262e9e00575a8fd780e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_d18fc8d04f95bcbc05f27711ffc3170c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_3ac6b3996cc210dc7c4b41602df13dcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2474054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_6cae041278e3a5ed2d19e3ffc6ee8a51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7be0ceee-45b2-59d3-9367-d92274e36dde/7be0ceee-45b2-59d3-9367-d92274e36dde_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/76/4376533b2a85f6e66f949f362c57d25b/pa/JB07830_1e78896e4494c2349a9e03e8dc634745.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D3 Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2018}
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB07830%27 HTTP/1.1" 200 None
2025-12-05 20:06:21 [auto1.it] INFO: Saving data for JB07830: {'created_time': 1764965181.409354, 'last_price_update_time': 1764965181.409366, 'auction_closing_time': 1765038045.0}
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB07830') HTTP/1.1" 204 0
2025-12-05 20:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_763eb7a2ff4fc6b8f3640c733441204f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_7d0d9325292f97fd05b18fa7babaad7f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_7d0d9325292f97fd05b18fa7babaad7f.jpg not downloaded yet
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_dd3ce075d359d856a7240f0beaa9c165.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_dd3ce075d359d856a7240f0beaa9c165.jpg not downloaded yet
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f8910>
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_0ac09d4ae934ce2aba2d0e5a1ac927df.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_0ac09d4ae934ce2aba2d0e5a1ac927df.jpg saved to cache
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00f5690>
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_5e5e2b35a16af15f869feab936ebad99.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_5e5e2b35a16af15f869feab936ebad99.jpg saved to cache
2025-12-05 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03cf0d0>
2025-12-05 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_84589cca0c8bd9fff8daa3aa0d3fa855.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_84589cca0c8bd9fff8daa3aa0d3fa855.jpg saved to cache
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_9103c9b6390ff4cfd323cefb98771380.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_37628edf626ccdb374f7768ad265c693.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_c3285fb8b35d6c2552c0feeee146fb69.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_c3285fb8b35d6c2552c0feeee146fb69.jpg not downloaded yet
2025-12-05 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_a2dde4561f03eb437cf85a5aa82c99aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_3812fef18ee65241bb66c5da6b6409e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3812fef18ee65241bb66c5da6b6409e7.jpg not downloaded yet
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01ed350>
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_da965309f5ca50b0189e7acfff936a34.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_da965309f5ca50b0189e7acfff936a34.jpg saved to cache
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b343d3938ae0b2917a3cc8bd30df78ef.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_cdd1cd3879787b10ea6a0b481f898a7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_cdd1cd3879787b10ea6a0b481f898a7e.jpg not downloaded yet
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0498cd0>
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_763eb7a2ff4fc6b8f3640c733441204f.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_763eb7a2ff4fc6b8f3640c733441204f.jpg saved to cache
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_e4af53349c94f257bbfd3c47182a6297.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_56f0be939eb85e35efb51101d12cf176.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_56f0be939eb85e35efb51101d12cf176.jpg not downloaded yet
2025-12-05 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_5ab9363cb487800e74d2060151361934.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_12d25a0e1d19aabb9a40cddd0f9210e7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_8eda7b2108768240bf943457265508b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_8eda7b2108768240bf943457265508b3.jpg not downloaded yet
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae015cb90>
2025-12-05 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_9103c9b6390ff4cfd323cefb98771380.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_9103c9b6390ff4cfd323cefb98771380.jpg saved to cache
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01d7850>
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_37628edf626ccdb374f7768ad265c693.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_37628edf626ccdb374f7768ad265c693.jpg saved to cache
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae061ea50>
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_a2dde4561f03eb437cf85a5aa82c99aa.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_a2dde4561f03eb437cf85a5aa82c99aa.jpg saved to cache
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_2ea2f2f089bc1576b2e870ae2045813d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:23 [scrapy.extensions.logstats] INFO: Crawled 432 pages (at 61 pages/min), scraped 148 items (at 24 items/min)
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_10fcf1ad66116a42575dfb37cb5d2a1e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_10fcf1ad66116a42575dfb37cb5d2a1e.jpg not downloaded yet
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_33d647f03fc601b34e3d415deca7ae02.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_33d647f03fc601b34e3d415deca7ae02.jpg not downloaded yet
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3668150>
2025-12-05 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_b343d3938ae0b2917a3cc8bd30df78ef.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b343d3938ae0b2917a3cc8bd30df78ef.jpg saved to cache
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3d52a1a815026c141650a4594420e045.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ed82c20c07cbdfbc3ffba4120553df7d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_f49d24468709f89571f8563cd4b0e2d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_f49d24468709f89571f8563cd4b0e2d4.jpg not downloaded yet
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02bc950>
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_e4af53349c94f257bbfd3c47182a6297.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_e4af53349c94f257bbfd3c47182a6297.jpg saved to cache
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3710910>
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_5ab9363cb487800e74d2060151361934.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_5ab9363cb487800e74d2060151361934.jpg saved to cache
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0371290>
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_12d25a0e1d19aabb9a40cddd0f9210e7.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_12d25a0e1d19aabb9a40cddd0f9210e7.jpg saved to cache
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_d9c572a88dbf03b489d9811ce1c967d4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_d9c572a88dbf03b489d9811ce1c967d4.jpg not downloaded yet
2025-12-05 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ee62c10a224cc2bc645d7ce6799c6b46.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_6cb7af1fa8c72da5444dac3c15c45880.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_6cb7af1fa8c72da5444dac3c15c45880.jpg not downloaded yet
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05c9790>
2025-12-05 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_2ea2f2f089bc1576b2e870ae2045813d.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_2ea2f2f089bc1576b2e870ae2045813d.jpg saved to cache
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_e56eceed18446edb239671bce8337702.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_e56eceed18446edb239671bce8337702.jpg not downloaded yet
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_b05ec33ed291cd4882e8d12fb8cd347b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b05ec33ed291cd4882e8d12fb8cd347b.jpg not downloaded yet
2025-12-05 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_dd3ce075d359d856a7240f0beaa9c165.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_c3285fb8b35d6c2552c0feeee146fb69.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_f9f1db7f24d7a12ef0ce42dbebf52104.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_f9f1db7f24d7a12ef0ce42dbebf52104.jpg not downloaded yet
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03efb90>
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_3d52a1a815026c141650a4594420e045.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3d52a1a815026c141650a4594420e045.jpg saved to cache
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e3210>
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_ed82c20c07cbdfbc3ffba4120553df7d.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ed82c20c07cbdfbc3ffba4120553df7d.jpg saved to cache
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04fb790>
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_ee62c10a224cc2bc645d7ce6799c6b46.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ee62c10a224cc2bc645d7ce6799c6b46.jpg saved to cache
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d598dd51515968bbdbea33b8424fba16.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_493a483c7b0efc87d4b30d809357d971.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_493a483c7b0efc87d4b30d809357d971.jpg not downloaded yet
2025-12-05 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_cdd1cd3879787b10ea6a0b481f898a7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e2490>
2025-12-05 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_dd3ce075d359d856a7240f0beaa9c165.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_dd3ce075d359d856a7240f0beaa9c165.jpg saved to cache
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36365d0>
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_c3285fb8b35d6c2552c0feeee146fb69.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_c3285fb8b35d6c2552c0feeee146fb69.jpg saved to cache
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_45da2fad1f7caaa550f278c815e7d9a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_45da2fad1f7caaa550f278c815e7d9a9.jpg not downloaded yet
2025-12-05 20:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c6f987ffc02a98803029a275bf5171f7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3812fef18ee65241bb66c5da6b6409e7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_56f0be939eb85e35efb51101d12cf176.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_80bfaf762257e29ea611212753d8747e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_80bfaf762257e29ea611212753d8747e.jpg not downloaded yet
2025-12-05 20:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b6450>
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_d598dd51515968bbdbea33b8424fba16.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d598dd51515968bbdbea33b8424fba16.jpg saved to cache
2025-12-05 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae061e410>
2025-12-05 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_cdd1cd3879787b10ea6a0b481f898a7e.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_cdd1cd3879787b10ea6a0b481f898a7e.jpg saved to cache
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_10fcf1ad66116a42575dfb37cb5d2a1e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_b402a321a85498e1aab7b06c61611c67.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_b402a321a85498e1aab7b06c61611c67.jpg not downloaded yet
2025-12-05 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_7d0d9325292f97fd05b18fa7babaad7f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_368c457c3464fef41b56f07853d95e26.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0487b90>
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb1%252F1bb15e2f985d5daf0160013e5bd757bd%252Fpa%252FUT73066_c6f987ffc02a98803029a275bf5171f7.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c6f987ffc02a98803029a275bf5171f7.jpg saved to cache
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b79619f7-5260-53d6-906f-b90b5de24320
2025-12-05 20:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b79619f7-5260-53d6-906f-b90b5de24320, skipping ID generation
2025-12-05 20:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79619f7-5260-53d6-906f-b90b5de24320 with scrape type 1
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b79619f7-5260-53d6-906f-b90b5de24320 from tracking dictionaries
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b79619f7-5260-53d6-906f-b90b5de24320 sending to next pipeline
2025-12-05 20:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b79619f7-5260-53d6-906f-b90b5de24320, identifier: UT73066
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae2533010>
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_3812fef18ee65241bb66c5da6b6409e7.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3812fef18ee65241bb66c5da6b6409e7.jpg saved to cache
2025-12-05 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae061c990>
2025-12-05 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_56f0be939eb85e35efb51101d12cf176.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_56f0be939eb85e35efb51101d12cf176.jpg saved to cache
2025-12-05 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b79619f7-5260-53d6-906f-b90b5de24320 with identifier: UT73066
2025-12-05 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b79619f7-5260-53d6-906f-b90b5de24320 with identifier: UT73066
2025-12-05 20:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b79619f7-5260-53d6-906f-b90b5de24320 with identifier: UT73066 to the API
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c6f987ffc02a98803029a275bf5171f7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:52:40Z',
 'fuel_type': 'petrol',
 'id': 'b79619f7-5260-53d6-906f-b90b5de24320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT73066',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 137407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c8c62f91225666386114a8c491f7efb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_d52168ed6667f6fcc678f4224b39c2f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_515e2e92afe835e503a9955de285dc61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_f8b66932edd480218a90d698d779ecc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cc9b29fa04ef0232ac2688828ef37d46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_cedee84d4aaa5717bba2100df90b60b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_4727241ab03490fd80904c771f1ba79e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_da965309f5ca50b0189e7acfff936a34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_280c6dc4e6469e3b989e7ea6604b55d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_0ac09d4ae934ce2aba2d0e5a1ac927df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_af26bf190da1b6d4b977fe2f449947c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_5ab9363cb487800e74d2060151361934.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_37628edf626ccdb374f7768ad265c693.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_e4af53349c94f257bbfd3c47182a6297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79619f7-5260-53d6-906f-b90b5de24320/b79619f7-5260-53d6-906f-b90b5de24320_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b1/1bb15e2f985d5daf0160013e5bd757bd/pa/UT73066_c6f987ffc02a98803029a275bf5171f7.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 Advance S&S',
 'transmission': 'manual',
 'trim': 'Advance S&S',
 'year': 2017}
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT73066%27 HTTP/1.1" 200 None
2025-12-05 20:06:28 [auto1.it] INFO: Saving data for UT73066: {'created_time': 1764965188.463481, 'last_price_update_time': 1764965188.463493, 'auction_closing_time': 1765039960.0}
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT73066') HTTP/1.1" 204 0
2025-12-05 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_f49d24468709f89571f8563cd4b0e2d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_6cb7af1fa8c72da5444dac3c15c45880.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b05ec33ed291cd4882e8d12fb8cd347b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_8eda7b2108768240bf943457265508b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD14180> (referer: https://www.auto1.com/v1/car-details-view/MD14180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01dac10>
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_10fcf1ad66116a42575dfb37cb5d2a1e.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_10fcf1ad66116a42575dfb37cb5d2a1e.jpg saved to cache
2025-12-05 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b5d10>
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_7d0d9325292f97fd05b18fa7babaad7f.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_7d0d9325292f97fd05b18fa7babaad7f.jpg saved to cache
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b6810>
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_368c457c3464fef41b56f07853d95e26.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_368c457c3464fef41b56f07853d95e26.jpg saved to cache
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c69f51a4124aa55495b5564a65656e78.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_493a483c7b0efc87d4b30d809357d971.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36375d0>
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_f49d24468709f89571f8563cd4b0e2d4.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_f49d24468709f89571f8563cd4b0e2d4.jpg saved to cache
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae037df50>
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_6cb7af1fa8c72da5444dac3c15c45880.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_6cb7af1fa8c72da5444dac3c15c45880.jpg saved to cache
2025-12-05 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b7090>
2025-12-05 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fff%252F58ff61a56c6f806bbe5cb4d7e61af0f3%252Fpa%252FTZ58430_b05ec33ed291cd4882e8d12fb8cd347b.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b05ec33ed291cd4882e8d12fb8cd347b.jpg saved to cache
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 20a24d4d-ffe8-54f8-9ddd-191411709da7
2025-12-05 20:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20a24d4d-ffe8-54f8-9ddd-191411709da7, skipping ID generation
2025-12-05 20:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20a24d4d-ffe8-54f8-9ddd-191411709da7 with scrape type 1
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 20a24d4d-ffe8-54f8-9ddd-191411709da7 from tracking dictionaries
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20a24d4d-ffe8-54f8-9ddd-191411709da7 sending to next pipeline
2025-12-05 20:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20a24d4d-ffe8-54f8-9ddd-191411709da7, identifier: TZ58430
2025-12-05 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a4050>
2025-12-05 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_8eda7b2108768240bf943457265508b3.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_8eda7b2108768240bf943457265508b3.jpg saved to cache
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180
2025-12-05 20:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with scrape type 1
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_333bc62906e306ec7d96257eea226d87.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_333bc62906e306ec7d96257eea226d87.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_037dc06289b1947c8d7a3897980de216.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_037dc06289b1947c8d7a3897980de216.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_f26533cba7e3e2496c1aa461ecada711.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_f26533cba7e3e2496c1aa461ecada711.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_91c5591e45773851b7f6b5ead5bf4015.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_91c5591e45773851b7f6b5ead5bf4015.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_5beb8f0df48e19bb9e928961d41f1f20.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_5beb8f0df48e19bb9e928961d41f1f20.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_3fb0130a51765e13971437d277d623f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_3fb0130a51765e13971437d277d623f2.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_251a071cfd50f5bb75f52dfb642aa003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_251a071cfd50f5bb75f52dfb642aa003.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_3f6832f3c2ce5a3b6866c52486c979b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_3f6832f3c2ce5a3b6866c52486c979b5.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_113e152f4940cc1b7b2ccc95fc8653d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_113e152f4940cc1b7b2ccc95fc8653d3.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_baa69cf16d358cb95ed82a3eb63f0d7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_baa69cf16d358cb95ed82a3eb63f0d7c.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_ef02e9e101e64cd3bce3b5adccb10226.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_ef02e9e101e64cd3bce3b5adccb10226.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_07db883af2b97606821fdc88408b89ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_07db883af2b97606821fdc88408b89ab.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_67a3aefabeb64f294a781daf262a1040.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_67a3aefabeb64f294a781daf262a1040.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_d99f7806c0bef0983ce44277f5b42042.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_d99f7806c0bef0983ce44277f5b42042.jpg already downloaded
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fbf%252Fdfbfb60a17bbbd2db4377a695de2e8db%252Fpa%252FMD14180_81356688b4c559eb1e41cbda6cc11a5e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_81356688b4c559eb1e41cbda6cc11a5e.jpg already downloaded
2025-12-05 20:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70, identifier: MD14180
2025-12-05 20:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430
2025-12-05 20:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430
2025-12-05 20:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20a24d4d-ffe8-54f8-9ddd-191411709da7 with identifier: TZ58430 to the API
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b05ec33ed291cd4882e8d12fb8cd347b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 333,
 'expiration_date': '2025-12-06T16:23:16Z',
 'fuel_type': 'petrol',
 'id': '20a24d4d-ffe8-54f8-9ddd-191411709da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ58430',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'BMW',
 'model': '8er',
 'odometer': 101539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_9103c9b6390ff4cfd323cefb98771380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_763eb7a2ff4fc6b8f3640c733441204f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b343d3938ae0b2917a3cc8bd30df78ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ed82c20c07cbdfbc3ffba4120553df7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_12d25a0e1d19aabb9a40cddd0f9210e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_2ea2f2f089bc1576b2e870ae2045813d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3d52a1a815026c141650a4594420e045.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_ee62c10a224cc2bc645d7ce6799c6b46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_dd3ce075d359d856a7240f0beaa9c165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_3812fef18ee65241bb66c5da6b6409e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_56f0be939eb85e35efb51101d12cf176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_10fcf1ad66116a42575dfb37cb5d2a1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_f49d24468709f89571f8563cd4b0e2d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_6cb7af1fa8c72da5444dac3c15c45880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20a24d4d-ffe8-54f8-9ddd-191411709da7/20a24d4d-ffe8-54f8-9ddd-191411709da7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/ff/58ff61a56c6f806bbe5cb4d7e61af0f3/pa/TZ58430_b05ec33ed291cd4882e8d12fb8cd347b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 8er 840i Gran Coupe Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2022}
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ58430%27 HTTP/1.1" 200 None
2025-12-05 20:06:31 [auto1.it] INFO: Saving data for TZ58430: {'created_time': 1764965191.629752, 'last_price_update_time': 1764965191.629764, 'auction_closing_time': 1765038196.0}
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ58430') HTTP/1.1" 204 0
2025-12-05 20:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180
2025-12-05 20:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180
2025-12-05 20:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70 with identifier: MD14180 to the API
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD14180>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:52:14Z',
 'fuel_type': 'petrol',
 'id': '367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD14180',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 65237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_333bc62906e306ec7d96257eea226d87.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_037dc06289b1947c8d7a3897980de216.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_f26533cba7e3e2496c1aa461ecada711.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_91c5591e45773851b7f6b5ead5bf4015.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_5beb8f0df48e19bb9e928961d41f1f20.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_3fb0130a51765e13971437d277d623f2.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_251a071cfd50f5bb75f52dfb642aa003.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_3f6832f3c2ce5a3b6866c52486c979b5.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_113e152f4940cc1b7b2ccc95fc8653d3.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_baa69cf16d358cb95ed82a3eb63f0d7c.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_ef02e9e101e64cd3bce3b5adccb10226.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_07db883af2b97606821fdc88408b89ab.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_67a3aefabeb64f294a781daf262a1040.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_d99f7806c0bef0983ce44277f5b42042.jpg',
                'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_81356688b4c559eb1e41cbda6cc11a5e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_333bc62906e306ec7d96257eea226d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_037dc06289b1947c8d7a3897980de216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_f26533cba7e3e2496c1aa461ecada711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_91c5591e45773851b7f6b5ead5bf4015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_5beb8f0df48e19bb9e928961d41f1f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_3fb0130a51765e13971437d277d623f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_251a071cfd50f5bb75f52dfb642aa003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_3f6832f3c2ce5a3b6866c52486c979b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_113e152f4940cc1b7b2ccc95fc8653d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_baa69cf16d358cb95ed82a3eb63f0d7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_ef02e9e101e64cd3bce3b5adccb10226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_07db883af2b97606821fdc88408b89ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_67a3aefabeb64f294a781daf262a1040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_d99f7806c0bef0983ce44277f5b42042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70/367fdbaa-6bb4-5fb3-b4c1-fd9b45199c70_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/bf/dfbfb60a17bbbd2db4377a695de2e8db/pa/MD14180_81356688b4c559eb1e41cbda6cc11a5e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Executive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion',
 'year': 2017}
2025-12-05 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2025-12-05 20:06:32 [auto1.it] INFO: Saving data for MD14180: {'created_time': 1764965192.001899, 'last_price_update_time': 1764965192.001909, 'auction_closing_time': 1765039934.0}
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD14180') HTTP/1.1" 204 0
2025-12-05 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_73615b354a35b88ce880054b05e15db7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_80bfaf762257e29ea611212753d8747e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_33d647f03fc601b34e3d415deca7ae02.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c5f50>
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_c69f51a4124aa55495b5564a65656e78.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c69f51a4124aa55495b5564a65656e78.jpg saved to cache
2025-12-05 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae044bf10>
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_493a483c7b0efc87d4b30d809357d971.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_493a483c7b0efc87d4b30d809357d971.jpg saved to cache
2025-12-05 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c013d9e62a892eeb32d87fc4034b3169.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_e56eceed18446edb239671bce8337702.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_f9f1db7f24d7a12ef0ce42dbebf52104.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05f0850>
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_73615b354a35b88ce880054b05e15db7.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_73615b354a35b88ce880054b05e15db7.jpg saved to cache
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01d6790>
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_80bfaf762257e29ea611212753d8747e.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_80bfaf762257e29ea611212753d8747e.jpg saved to cache
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01d7250>
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_33d647f03fc601b34e3d415deca7ae02.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_33d647f03fc601b34e3d415deca7ae02.jpg saved to cache
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_45da2fad1f7caaa550f278c815e7d9a9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_f83c2ae55cb9b197614a848d7c903910.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_b402a321a85498e1aab7b06c61611c67.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_3800bda0ceab20624c78f40655adb62b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0371150>
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_c013d9e62a892eeb32d87fc4034b3169.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c013d9e62a892eeb32d87fc4034b3169.jpg saved to cache
2025-12-05 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022cf90>
2025-12-05 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_e56eceed18446edb239671bce8337702.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_e56eceed18446edb239671bce8337702.jpg saved to cache
2025-12-05 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2025:12:05 10:14:09\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04876d0>
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_f9f1db7f24d7a12ef0ce42dbebf52104.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_f9f1db7f24d7a12ef0ce42dbebf52104.jpg saved to cache
2025-12-05 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_d9c572a88dbf03b489d9811ce1c967d4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_de2cf80e67840207d946e1095d86f3e1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a9fa7432f0b08dc3231c5a04652da915.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_f9bded3e9c6900914f3139ae55cc7c99.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_f2b80cc7ab9145d7525da995b0e3c243.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2025:12:05 10:14:28\x00'
2025-12-05 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae017fe10>
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_45da2fad1f7caaa550f278c815e7d9a9.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_45da2fad1f7caaa550f278c815e7d9a9.jpg saved to cache
2025-12-05 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae024ed90>
2025-12-05 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_f83c2ae55cb9b197614a848d7c903910.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_f83c2ae55cb9b197614a848d7c903910.jpg saved to cache
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b6550>
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_b402a321a85498e1aab7b06c61611c67.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_b402a321a85498e1aab7b06c61611c67.jpg saved to cache
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a7bd0>
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_3800bda0ceab20624c78f40655adb62b.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_3800bda0ceab20624c78f40655adb62b.jpg saved to cache
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_ba605e79f90464611c785cd5f4a674eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_18b8e092ba43faae61198acc3dc0dc5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_aa2f83bf1a1ad26bdc162a8da5f93aea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363e810>
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F2e%252F2e2eb31554658cc0a35a12d2e602f644%252Fpa%252FRC08182_d9c572a88dbf03b489d9811ce1c967d4.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_d9c572a88dbf03b489d9811ce1c967d4.jpg saved to cache
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c92a7915-22e0-518f-b55f-58a2e6642828
2025-12-05 20:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c92a7915-22e0-518f-b55f-58a2e6642828, skipping ID generation
2025-12-05 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92a7915-22e0-518f-b55f-58a2e6642828 with scrape type 1
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c92a7915-22e0-518f-b55f-58a2e6642828 from tracking dictionaries
2025-12-05 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c92a7915-22e0-518f-b55f-58a2e6642828 sending to next pipeline
2025-12-05 20:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c92a7915-22e0-518f-b55f-58a2e6642828, identifier: RC08182
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0487590>
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_de2cf80e67840207d946e1095d86f3e1.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_de2cf80e67840207d946e1095d86f3e1.jpg saved to cache
2025-12-05 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f29d0>
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_a9fa7432f0b08dc3231c5a04652da915.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a9fa7432f0b08dc3231c5a04652da915.jpg saved to cache
2025-12-05 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0394790>
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_f9bded3e9c6900914f3139ae55cc7c99.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_f9bded3e9c6900914f3139ae55cc7c99.jpg saved to cache
2025-12-05 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b4750>
2025-12-05 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_f2b80cc7ab9145d7525da995b0e3c243.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_f2b80cc7ab9145d7525da995b0e3c243.jpg saved to cache
2025-12-05 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c92a7915-22e0-518f-b55f-58a2e6642828 with identifier: RC08182
2025-12-05 20:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c92a7915-22e0-518f-b55f-58a2e6642828 with identifier: RC08182
2025-12-05 20:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c92a7915-22e0-518f-b55f-58a2e6642828 with identifier: RC08182 to the API
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_d9c572a88dbf03b489d9811ce1c967d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:04:20Z',
 'fuel_type': 'gas',
 'id': 'c92a7915-22e0-518f-b55f-58a2e6642828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC08182',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 139557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1010949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_368c457c3464fef41b56f07853d95e26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1010949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_7d0d9325292f97fd05b18fa7babaad7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_c3285fb8b35d6c2552c0feeee146fb69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_cdd1cd3879787b10ea6a0b481f898a7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_8eda7b2108768240bf943457265508b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_33d647f03fc601b34e3d415deca7ae02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 985622,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_d9c572a88dbf03b489d9811ce1c967d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1042229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_e56eceed18446edb239671bce8337702.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 980263,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_f9f1db7f24d7a12ef0ce42dbebf52104.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_493a483c7b0efc87d4b30d809357d971.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_45da2fad1f7caaa550f278c815e7d9a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_80bfaf762257e29ea611212753d8747e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92a7915-22e0-518f-b55f-58a2e6642828/c92a7915-22e0-518f-b55f-58a2e6642828_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733232,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/2e/2e2eb31554658cc0a35a12d2e602f644/pa/RC08182_b402a321a85498e1aab7b06c61611c67.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TGI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC08182%27 HTTP/1.1" 200 None
2025-12-05 20:06:37 [auto1.it] INFO: Saving data for RC08182: {'created_time': 1764965197.627774, 'last_price_update_time': 1764965197.627784, 'auction_closing_time': 1765037060.0}
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC08182') HTTP/1.1" 204 0
2025-12-05 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_20d297d8b7db467d6f79b4173a51cfa4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_5d5e0b2b5a520de7cf854f1983d8ae34.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a99fe03e93b21f855c8b1d60d99b374b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU15302> (referer: https://www.auto1.com/v1/car-details-view/LU15302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e2790>
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_ba605e79f90464611c785cd5f4a674eb.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_ba605e79f90464611c785cd5f4a674eb.jpg saved to cache
2025-12-05 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36348d0>
2025-12-05 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_18b8e092ba43faae61198acc3dc0dc5b.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_18b8e092ba43faae61198acc3dc0dc5b.jpg saved to cache
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad360fad0>
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_aa2f83bf1a1ad26bdc162a8da5f93aea.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_aa2f83bf1a1ad26bdc162a8da5f93aea.jpg saved to cache
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_dfb6561cf2b0c992aad496cc36855d6d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_96491fe8f06f45f146b6422ce82f7a01.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c6d1a68123c0ae4d820fe85f88be72bc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d6031208fac93a5a5ea8af5bd9e085a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00b5250>
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_20d297d8b7db467d6f79b4173a51cfa4.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_20d297d8b7db467d6f79b4173a51cfa4.jpg saved to cache
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e28d0>
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_5d5e0b2b5a520de7cf854f1983d8ae34.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_5d5e0b2b5a520de7cf854f1983d8ae34.jpg saved to cache
2025-12-05 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05f3350>
2025-12-05 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_a99fe03e93b21f855c8b1d60d99b374b.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a99fe03e93b21f855c8b1d60d99b374b.jpg saved to cache
2025-12-05 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4140f5a2-a454-5672-b376-2673f14d42a3 with identifier: LU15302
2025-12-05 20:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4140f5a2-a454-5672-b376-2673f14d42a3 with scrape type 2
2025-12-05 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4140f5a2-a454-5672-b376-2673f14d42a3 with scrape type 2
2025-12-05 20:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4140f5a2-a454-5672-b376-2673f14d42a3, identifier: LU15302
2025-12-05 20:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4140f5a2-a454-5672-b376-2673f14d42a3 with identifier: LU15302
2025-12-05 20:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4140f5a2-a454-5672-b376-2673f14d42a3 with identifier: LU15302
2025-12-05 20:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4140f5a2-a454-5672-b376-2673f14d42a3 with identifier: LU15302 to the API
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LU15302>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:26:11Z',
 'fuel_type': 'petrol',
 'id': '4140f5a2-a454-5672-b376-2673f14d42a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU15302',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 116400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU15302%27 HTTP/1.1" 200 None
2025-12-05 20:06:39 [auto1.it] INFO: Saving data for LU15302: {'auction_closing_time': 1765038371.0, 'created_time': 1763064262.475079, 'last_price_update_time': 1764965199.664336}
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU15302') HTTP/1.1" 204 0
2025-12-05 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_9f1cb02ebd24ed459a628ef719c416bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_863fb59f133405b509132f36736d8fcd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_07af4880d501b3cc673e79184e661303.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae033d550>
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_dfb6561cf2b0c992aad496cc36855d6d.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_dfb6561cf2b0c992aad496cc36855d6d.jpg saved to cache
2025-12-05 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3709f50>
2025-12-05 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_96491fe8f06f45f146b6422ce82f7a01.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_96491fe8f06f45f146b6422ce82f7a01.jpg saved to cache
2025-12-05 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363d310>
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_c6d1a68123c0ae4d820fe85f88be72bc.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c6d1a68123c0ae4d820fe85f88be72bc.jpg saved to cache
2025-12-05 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04ba9d0>
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_5d6031208fac93a5a5ea8af5bd9e085a.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d6031208fac93a5a5ea8af5bd9e085a.jpg saved to cache
2025-12-05 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_b0f912ed9b220dfd42a7fc61b223311a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_938255a70cdfa8ff38b8990dd0f41fba.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0187b90>
2025-12-05 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_9f1cb02ebd24ed459a628ef719c416bb.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_9f1cb02ebd24ed459a628ef719c416bb.jpg saved to cache
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d68d0>
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_863fb59f133405b509132f36736d8fcd.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_863fb59f133405b509132f36736d8fcd.jpg saved to cache
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d7290>
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_07af4880d501b3cc673e79184e661303.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_07af4880d501b3cc673e79184e661303.jpg saved to cache
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_4202e3bbb465256b660514557769f928.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_07502b022c3654bd1f94a9ef7018c903.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_9c057f8951fd4d64a3b5f3a1cfda48ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022e610>
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fd5%252F64d5306c274887a6635bff035cff3a23%252Fpa%252FMW43217_b0f912ed9b220dfd42a7fc61b223311a.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_b0f912ed9b220dfd42a7fc61b223311a.jpg saved to cache
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdf151b7-4391-5568-acb9-041518a8171e
2025-12-05 20:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdf151b7-4391-5568-acb9-041518a8171e, skipping ID generation
2025-12-05 20:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf151b7-4391-5568-acb9-041518a8171e with scrape type 1
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bdf151b7-4391-5568-acb9-041518a8171e from tracking dictionaries
2025-12-05 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdf151b7-4391-5568-acb9-041518a8171e sending to next pipeline
2025-12-05 20:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bdf151b7-4391-5568-acb9-041518a8171e, identifier: MW43217
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae009aed0>
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_938255a70cdfa8ff38b8990dd0f41fba.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_938255a70cdfa8ff38b8990dd0f41fba.jpg saved to cache
2025-12-05 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bdf151b7-4391-5568-acb9-041518a8171e with identifier: MW43217
2025-12-05 20:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bdf151b7-4391-5568-acb9-041518a8171e with identifier: MW43217
2025-12-05 20:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bdf151b7-4391-5568-acb9-041518a8171e with identifier: MW43217 to the API
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_b0f912ed9b220dfd42a7fc61b223311a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:34:40Z',
 'fuel_type': 'diesel',
 'id': 'bdf151b7-4391-5568-acb9-041518a8171e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW43217',
 'listing': 'auction',
 'location': 'IT, Polignano a Mare (BA)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 36336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48438,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_b0f912ed9b220dfd42a7fc61b223311a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48438,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_863fb59f133405b509132f36736d8fcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47643,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a99fe03e93b21f855c8b1d60d99b374b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46136,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_20d297d8b7db467d6f79b4173a51cfa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46136,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_ba605e79f90464611c785cd5f4a674eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52035,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_a9fa7432f0b08dc3231c5a04652da915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48438,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_de2cf80e67840207d946e1095d86f3e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54112,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_f83c2ae55cb9b197614a848d7c903910.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47078,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_84589cca0c8bd9fff8daa3aa0d3fa855.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44288,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_85107d4e2e95dda045b7e8a080a8bad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40790,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_4c883ad045c94cc2a09374196bc8beff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34757,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_870f2d2882b3bab788af20b28ff00cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42464,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_80273e0ecdc9ddbeb47e95e23294549a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf151b7-4391-5568-acb9-041518a8171e/bdf151b7-4391-5568-acb9-041518a8171e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35895,
             'Height': 369,
             'OriginUrl': 'https://img-pa.auto1.com/img64/d5/64d5306c274887a6635bff035cff3a23/pa/MW43217_d75a7c4a69aa7596bb24ef1312bcbcd5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW43217%27 HTTP/1.1" 200 None
2025-12-05 20:06:42 [auto1.it] INFO: Saving data for MW43217: {'created_time': 1764965202.694329, 'last_price_update_time': 1764965202.694342, 'auction_closing_time': 1765038880.0}
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MW43217') HTTP/1.1" 204 0
2025-12-05 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_65951bfdf5c2d64c71937ce28324766f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c6d50>
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fd9%252F21d95df3f7c3dbc94996942bbf46aed7%252Fpa%252FXT46123_4202e3bbb465256b660514557769f928.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_4202e3bbb465256b660514557769f928.jpg saved to cache
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8
2025-12-05 20:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8, skipping ID generation
2025-12-05 20:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 with scrape type 1
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 from tracking dictionaries
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 sending to next pipeline
2025-12-05 20:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8, identifier: XT46123
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0395250>
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_07502b022c3654bd1f94a9ef7018c903.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_07502b022c3654bd1f94a9ef7018c903.jpg saved to cache
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f9c10>
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_9c057f8951fd4d64a3b5f3a1cfda48ba.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_9c057f8951fd4d64a3b5f3a1cfda48ba.jpg saved to cache
2025-12-05 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 with identifier: XT46123
2025-12-05 20:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 with identifier: XT46123
2025-12-05 20:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8 with identifier: XT46123 to the API
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_4202e3bbb465256b660514557769f928.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 105,
 'expiration_date': '2025-12-06T16:36:12Z',
 'fuel_type': 'diesel',
 'id': '41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT46123',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 76819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_07af4880d501b3cc673e79184e661303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c6d1a68123c0ae4d820fe85f88be72bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 987098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_4202e3bbb465256b660514557769f928.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_96491fe8f06f45f146b6422ce82f7a01.jpg',
             'Width': 1801},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_f2b80cc7ab9145d7525da995b0e3c243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 979877,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_dfb6561cf2b0c992aad496cc36855d6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_3800bda0ceab20624c78f40655adb62b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1123543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_aa2f83bf1a1ad26bdc162a8da5f93aea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_c904c6d8df1a23fd78430905a71b765b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_5e5e2b35a16af15f869feab936ebad99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_e83c9ce8c5de73b877f71e9725fcca10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_686fd9751de6a647401d896908b64f0e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8/41c592f1-ce7f-58a0-bf6f-2bcc1266d6d8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/d9/21d95df3f7c3dbc94996942bbf46aed7/pa/XT46123_d9621871195b60a7a36ae01d3fac0796.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT46123%27 HTTP/1.1" 200 None
2025-12-05 20:06:43 [auto1.it] INFO: Saving data for XT46123: {'created_time': 1764965203.996854, 'last_price_update_time': 1764965203.996866, 'auction_closing_time': 1765038972.0}
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT46123') HTTP/1.1" 204 0
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK00729/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU65956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB02360/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT10287> (referer: https://www.auto1.com/v1/car-details-view/RT10287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY71575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00b7d50>
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_65951bfdf5c2d64c71937ce28324766f.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_65951bfdf5c2d64c71937ce28324766f.jpg saved to cache
2025-12-05 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8e45691b132179d316150ce647f0458b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71e0b19-e15e-5d4d-b593-9e67395c6288 with identifier: RT10287
2025-12-05 20:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71e0b19-e15e-5d4d-b593-9e67395c6288 with scrape type 2
2025-12-05 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71e0b19-e15e-5d4d-b593-9e67395c6288 with scrape type 2
2025-12-05 20:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c71e0b19-e15e-5d4d-b593-9e67395c6288, identifier: RT10287
2025-12-05 20:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c71e0b19-e15e-5d4d-b593-9e67395c6288 with identifier: RT10287
2025-12-05 20:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c71e0b19-e15e-5d4d-b593-9e67395c6288 with identifier: RT10287
2025-12-05 20:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2025-12-05 20:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c71e0b19-e15e-5d4d-b593-9e67395c6288 spider: auto1.it
2025-12-05 20:06:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c71e0b19-e15e-5d4d-b593-9e67395c6288 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:29:13Z',
 'fuel_type': 'petrol',
 'id': 'c71e0b19-e15e-5d4d-b593-9e67395c6288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT10287',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 115458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2022}
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10287%27 HTTP/1.1" 200 None
2025-12-05 20:06:44 [auto1.it] INFO: Saving data for RT10287: {'auction_closing_time': 1765038553.0, 'created_time': 1764014792.086933, 'last_price_update_time': 1764965204.703143}
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT10287') HTTP/1.1" 204 0
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8a0d02980a66e372dfd6b0edc4cd5de5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM32123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3712c50>
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_8e45691b132179d316150ce647f0458b.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8e45691b132179d316150ce647f0458b.jpg saved to cache
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY34692/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW18274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0636390>
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_8a0d02980a66e372dfd6b0edc4cd5de5.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8a0d02980a66e372dfd6b0edc4cd5de5.jpg saved to cache
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d79a36dee90db84bfdcd35705a2ff735.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c6efea5f0472c347e66dfe0a8b866875.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_38cfa5f5adcd237a3871aac1613a0dc6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d87a0e7cd6edd856510813c9cf5a3e6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01cced0>
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F39%252F383963d86f3d14798a0a12cae14650aa%252Fpa%252FZH40946_d79a36dee90db84bfdcd35705a2ff735.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d79a36dee90db84bfdcd35705a2ff735.jpg saved to cache
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db929b3c-038f-5cb0-ad78-1a6730620cf2
2025-12-05 20:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db929b3c-038f-5cb0-ad78-1a6730620cf2, skipping ID generation
2025-12-05 20:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db929b3c-038f-5cb0-ad78-1a6730620cf2 with scrape type 1
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db929b3c-038f-5cb0-ad78-1a6730620cf2 from tracking dictionaries
2025-12-05 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db929b3c-038f-5cb0-ad78-1a6730620cf2 sending to next pipeline
2025-12-05 20:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db929b3c-038f-5cb0-ad78-1a6730620cf2, identifier: ZH40946
2025-12-05 20:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db929b3c-038f-5cb0-ad78-1a6730620cf2 with identifier: ZH40946
2025-12-05 20:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db929b3c-038f-5cb0-ad78-1a6730620cf2 with identifier: ZH40946
2025-12-05 20:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159834 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159834
2025-12-05 20:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: db929b3c-038f-5cb0-ad78-1a6730620cf2 spider: auto1.it
2025-12-05 20:06:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: db929b3c-038f-5cb0-ad78-1a6730620cf2 due to rule: high_mileage_for_country.json, error: 159834 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159834
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:21:00Z',
 'fuel_type': 'diesel',
 'id': 'db929b3c-038f-5cb0-ad78-1a6730620cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH40946',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 159834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_9f1cb02ebd24ed459a628ef719c416bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2307139,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d79a36dee90db84bfdcd35705a2ff735.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_5d5e0b2b5a520de7cf854f1983d8ae34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_18b8e092ba43faae61198acc3dc0dc5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8a0d02980a66e372dfd6b0edc4cd5de5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_f9bded3e9c6900914f3139ae55cc7c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_8e45691b132179d316150ce647f0458b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c013d9e62a892eeb32d87fc4034b3169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416350,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_c69f51a4124aa55495b5564a65656e78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3073329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_73615b354a35b88ce880054b05e15db7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d598dd51515968bbdbea33b8424fba16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_d326e45e95922208383665f5c854ab94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_b1accfb0a706e18b9d0c500eb2f7c175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540017,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_a2dde4561f03eb437cf85a5aa82c99aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db929b3c-038f-5cb0-ad78-1a6730620cf2/db929b3c-038f-5cb0-ad78-1a6730620cf2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/39/383963d86f3d14798a0a12cae14650aa/pa/ZH40946_cd80cbd486ee10f06115684fa164ecf3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2018}
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH40946%27 HTTP/1.1" 200 None
2025-12-05 20:06:46 [auto1.it] INFO: Saving data for ZH40946: {'created_time': 1764965206.205095, 'last_price_update_time': 1764965206.205107, 'auction_closing_time': 1765038060.0}
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH40946') HTTP/1.1" 204 0
2025-12-05 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB92069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM04068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG58363/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB86723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03ce010>
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_c6efea5f0472c347e66dfe0a8b866875.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c6efea5f0472c347e66dfe0a8b866875.jpg saved to cache
2025-12-05 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d6010>
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_38cfa5f5adcd237a3871aac1613a0dc6.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_38cfa5f5adcd237a3871aac1613a0dc6.jpg saved to cache
2025-12-05 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d6310>
2025-12-05 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F54%252F7d545816ea96a931ddb3c9f4fd1115d7%252Fpa%252FHS63299_5d87a0e7cd6edd856510813c9cf5a3e6.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d87a0e7cd6edd856510813c9cf5a3e6.jpg saved to cache
2025-12-05 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5
2025-12-05 20:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6a4ec63-aef6-5be5-b07c-a53b45badbe5, skipping ID generation
2025-12-05 20:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5 with scrape type 1
2025-12-05 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d6a4ec63-aef6-5be5-b07c-a53b45badbe5 from tracking dictionaries
2025-12-05 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6a4ec63-aef6-5be5-b07c-a53b45badbe5 sending to next pipeline
2025-12-05 20:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d6a4ec63-aef6-5be5-b07c-a53b45badbe5, identifier: HS63299
2025-12-05 20:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d6a4ec63-aef6-5be5-b07c-a53b45badbe5 with identifier: HS63299
2025-12-05 20:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d6a4ec63-aef6-5be5-b07c-a53b45badbe5 with identifier: HS63299
2025-12-05 20:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d6a4ec63-aef6-5be5-b07c-a53b45badbe5 with identifier: HS63299 to the API
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d87a0e7cd6edd856510813c9cf5a3e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:27:49Z',
 'fuel_type': 'petrol',
 'id': 'd6a4ec63-aef6-5be5-b07c-a53b45badbe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS63299',
 'listing': 'auction',
 'location': 'IT, Desio (MB)',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 123588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e5db9d9361d9b47eaa0ac68a4dd8523a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_945e068e29f2bf18a4e46501a0938ee4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_65951bfdf5c2d64c71937ce28324766f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2098753,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_29b4ac650e2888e957a292208c714f13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2358299,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c053fc084300830a3df614666c835c66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_88ede3a2bcbd592d5e34fa81e56d78bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2375696,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_428d26383b65e1b209cd997502972602.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518455,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_e317a92494a74f53c038ecf7aa50b2c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_38cfa5f5adcd237a3871aac1613a0dc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2559212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d87a0e7cd6edd856510813c9cf5a3e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_9c057f8951fd4d64a3b5f3a1cfda48ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_07502b022c3654bd1f94a9ef7018c903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769119,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_39d92ad0e9788810f0034f915df1821a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_938255a70cdfa8ff38b8990dd0f41fba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_c6efea5f0472c347e66dfe0a8b866875.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6a4ec63-aef6-5be5-b07c-a53b45badbe5/d6a4ec63-aef6-5be5-b07c-a53b45badbe5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/54/7d545816ea96a931ddb3c9f4fd1115d7/pa/HS63299_5d6031208fac93a5a5ea8af5bd9e085a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Longitude 4x2',
 'transmission': 'manual',
 'trim': 'Longitude 4x2',
 'year': 2020}
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS63299%27 HTTP/1.1" 200 None
2025-12-05 20:06:47 [auto1.it] INFO: Saving data for HS63299: {'created_time': 1764965207.872571, 'last_price_update_time': 1764965207.872584, 'auction_closing_time': 1765038469.0}
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS63299') HTTP/1.1" 204 0
2025-12-05 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ40954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD68470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ94683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW14476/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY71575> (referer: https://www.auto1.com/v1/car-details-view/VY71575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce7210a2-8a70-5aff-a513-66255087e846 with identifier: VY71575
2025-12-05 20:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7210a2-8a70-5aff-a513-66255087e846 with scrape type 1
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_f29fe9d9d5f6b5bf2ead9afce108925e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_f29fe9d9d5f6b5bf2ead9afce108925e.jpg not downloaded yet
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_50c2ff24bd5e013d1be71a99820f834a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_50c2ff24bd5e013d1be71a99820f834a.jpg not downloaded yet
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_6c62f5f0d2edd2c1b4e9a5f891042a52.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_6c62f5f0d2edd2c1b4e9a5f891042a52.jpg not downloaded yet
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_9b262dbe24a0203b8fa4e5b9b42751b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_9b262dbe24a0203b8fa4e5b9b42751b3.jpg not downloaded yet
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_47b6f8d5d4f7447ad703b6ecc2215454.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47b6f8d5d4f7447ad703b6ecc2215454.jpg not downloaded yet
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_056548d84bf5d2999a41ab12349288d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_056548d84bf5d2999a41ab12349288d9.jpg not downloaded yet
2025-12-05 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK00729> (referer: https://www.auto1.com/v1/car-details-view/XK00729/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_0ccfc342522d0a8779aa57ef90a0daab.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_0ccfc342522d0a8779aa57ef90a0daab.jpg not downloaded yet
2025-12-05 20:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_62b521f77d82ab8d92e56c340db7628a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_62b521f77d82ab8d92e56c340db7628a.jpg not downloaded yet
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_5eabbdd7df897b49ae6971302ff62e66.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_5eabbdd7df897b49ae6971302ff62e66.jpg not downloaded yet
2025-12-05 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY34692> (referer: https://www.auto1.com/v1/car-details-view/NY34692/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_47f90d19c62faf97b4f8fdae11ce87bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47f90d19c62faf97b4f8fdae11ce87bb.jpg not downloaded yet
2025-12-05 20:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM32123> (referer: https://www.auto1.com/v1/car-details-view/NM32123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_4a8cd38dc0338af13ac7dae8a3514fcb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_4a8cd38dc0338af13ac7dae8a3514fcb.jpg not downloaded yet
2025-12-05 20:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_882ddd1a412d27ad203ed3a5a8d05af0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_882ddd1a412d27ad203ed3a5a8d05af0.jpg not downloaded yet
2025-12-05 20:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d773e5c-48ef-5a91-b816-d02bb3d3bf88 with identifier: XK00729
2025-12-05 20:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d773e5c-48ef-5a91-b816-d02bb3d3bf88 with scrape type 1
2025-12-05 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 4d773e5c-48ef-5a91-b816-d02bb3d3bf88
2025-12-05 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_59a95b63e64fae9cbdfd49b720624daf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_59a95b63e64fae9cbdfd49b720624daf.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_50f3b901ead1c442bcf3c9dd1e3f1bea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_50f3b901ead1c442bcf3c9dd1e3f1bea.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_a7ccfd11c28d2cdc0b745a4648ff19e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_a7ccfd11c28d2cdc0b745a4648ff19e7.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_0de00133a0f788516c9184452921991a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_0de00133a0f788516c9184452921991a.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_80e92214b4ea7dde4b2697aba8d44c8a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_80e92214b4ea7dde4b2697aba8d44c8a.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_6d0be6aef43eba48033249c97f9b075f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_6d0be6aef43eba48033249c97f9b075f.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_2071f7c01841b947954d634206a2452c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_2071f7c01841b947954d634206a2452c.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_cc8a1dd16c56448e38a19bec0aa95b79.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_cc8a1dd16c56448e38a19bec0aa95b79.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_499623198ad321a0195977d7679e3ed5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_499623198ad321a0195977d7679e3ed5.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_2f2fc63bf25b8f2f8e4e1b996adbbad4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_2f2fc63bf25b8f2f8e4e1b996adbbad4.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_50acb5f5877e2ff44dfefeb414882021.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_50acb5f5877e2ff44dfefeb414882021.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_c4fb46c88ea4ef58e3540bc3a4e93196.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_c4fb46c88ea4ef58e3540bc3a4e93196.jpg already downloaded
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fcc%252Fdfcc7873c68664fcfe03a1d1edf43db0%252Fpa%252FXK00729_6f5df5a314b19486b3bc1aa6b754cff0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_6f5df5a314b19486b3bc1aa6b754cff0.jpg already downloaded
2025-12-05 20:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d773e5c-48ef-5a91-b816-d02bb3d3bf88, identifier: XK00729
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_c81f9f517a8554434791cd66a1a9cbee.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_c81f9f517a8554434791cd66a1a9cbee.jpg not downloaded yet
2025-12-05 20:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d773e5c-48ef-5a91-b816-d02bb3d3bf88 with identifier: XK00729
2025-12-05 20:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d773e5c-48ef-5a91-b816-d02bb3d3bf88 with identifier: XK00729
2025-12-05 20:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d773e5c-48ef-5a91-b816-d02bb3d3bf88 with identifier: XK00729 to the API
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK00729>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:12:35Z',
 'fuel_type': 'diesel',
 'id': '4d773e5c-48ef-5a91-b816-d02bb3d3bf88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK00729',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 114782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_59a95b63e64fae9cbdfd49b720624daf.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_50f3b901ead1c442bcf3c9dd1e3f1bea.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_a7ccfd11c28d2cdc0b745a4648ff19e7.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_0de00133a0f788516c9184452921991a.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_80e92214b4ea7dde4b2697aba8d44c8a.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_6d0be6aef43eba48033249c97f9b075f.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_2071f7c01841b947954d634206a2452c.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_cc8a1dd16c56448e38a19bec0aa95b79.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_499623198ad321a0195977d7679e3ed5.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_2f2fc63bf25b8f2f8e4e1b996adbbad4.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_50acb5f5877e2ff44dfefeb414882021.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_c4fb46c88ea4ef58e3540bc3a4e93196.jpg',
                'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_6f5df5a314b19486b3bc1aa6b754cff0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4487467,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_59a95b63e64fae9cbdfd49b720624daf.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4487467,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_50f3b901ead1c442bcf3c9dd1e3f1bea.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3447860,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_a7ccfd11c28d2cdc0b745a4648ff19e7.jpg',
             'Width': 3564},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3623042,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_0de00133a0f788516c9184452921991a.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4307908,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_80e92214b4ea7dde4b2697aba8d44c8a.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3770466,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_6d0be6aef43eba48033249c97f9b075f.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3761419,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_2071f7c01841b947954d634206a2452c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4589920,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_cc8a1dd16c56448e38a19bec0aa95b79.jpg',
             'Width': 4608},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3857309,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_499623198ad321a0195977d7679e3ed5.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4434791,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_2f2fc63bf25b8f2f8e4e1b996adbbad4.jpg',
             'Width': 4608},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3739523,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_50acb5f5877e2ff44dfefeb414882021.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2993221,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_c4fb46c88ea4ef58e3540bc3a4e93196.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d773e5c-48ef-5a91-b816-d02bb3d3bf88/4d773e5c-48ef-5a91-b816-d02bb3d3bf88_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3478307,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/cc/dfcc7873c68664fcfe03a1d1edf43db0/pa/XK00729_6f5df5a314b19486b3bc1aa6b754cff0.jpg',
             'Width': 4608}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2018}
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK00729%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [auto1.it] INFO: Saving data for XK00729: {'created_time': 1764965209.754825, 'last_price_update_time': 1764965209.754834, 'auction_closing_time': 1765037555.0}
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XK00729') HTTP/1.1" 204 0
2025-12-05 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY98220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47f90d19c62faf97b4f8fdae11ce87bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_056548d84bf5d2999a41ab12349288d9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_5eabbdd7df897b49ae6971302ff62e66.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_93f8921260b4dfb7601b67cb13c1f43f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_93f8921260b4dfb7601b67cb13c1f43f.jpg not downloaded yet
2025-12-05 20:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS22846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB02360> (referer: https://www.auto1.com/v1/car-details-view/DB02360/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU65956> (referer: https://www.auto1.com/v1/car-details-view/DU65956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf095527-c15b-54e4-91f4-6e54b27022af with identifier: NY34692
2025-12-05 20:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf095527-c15b-54e4-91f4-6e54b27022af with scrape type 2
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf095527-c15b-54e4-91f4-6e54b27022af with scrape type 2
2025-12-05 20:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf095527-c15b-54e4-91f4-6e54b27022af, identifier: NY34692
2025-12-05 20:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133a6ce1-7451-5af5-a6c4-ab315235ef39 with identifier: NM32123
2025-12-05 20:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133a6ce1-7451-5af5-a6c4-ab315235ef39 with scrape type 1
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_f4274c02e19af91ed2e0e12ea530903d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_f4274c02e19af91ed2e0e12ea530903d.jpg not downloaded yet
2025-12-05 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_59164ac09c1a4b8bf913e3c1e6bff9ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_59164ac09c1a4b8bf913e3c1e6bff9ba.jpg not downloaded yet
2025-12-05 20:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf095527-c15b-54e4-91f4-6e54b27022af with identifier: NY34692
2025-12-05 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf095527-c15b-54e4-91f4-6e54b27022af with identifier: NY34692
2025-12-05 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156856 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156856
2025-12-05 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cf095527-c15b-54e4-91f4-6e54b27022af spider: auto1.it
2025-12-05 20:06:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: cf095527-c15b-54e4-91f4-6e54b27022af due to rule: high_mileage_for_country.json, error: 156856 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156856
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:34:16Z',
 'fuel_type': 'petrol',
 'id': 'cf095527-c15b-54e4-91f4-6e54b27022af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY34692',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 156856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Xpossible 2WD',
 'transmission': 'manual',
 'trim': 'Xpossible 2WD',
 'year': 2018}
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY34692%27 HTTP/1.1" 200 None
2025-12-05 20:06:50 [auto1.it] INFO: Saving data for NY34692: {'auction_closing_time': 1765038856.0, 'created_time': 1762286716.000721, 'last_price_update_time': 1764965210.249341}
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY34692') HTTP/1.1" 204 0
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_e1134f0d4096e09ccc41bc92f4f01cc1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e1134f0d4096e09ccc41bc92f4f01cc1.jpg not downloaded yet
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_2dc3ee13d773e51f06399a3a3d3b557f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_2dc3ee13d773e51f06399a3a3d3b557f.jpg not downloaded yet
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3727890>
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_47f90d19c62faf97b4f8fdae11ce87bb.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47f90d19c62faf97b4f8fdae11ce87bb.jpg saved to cache
2025-12-05 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05214d0>
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_056548d84bf5d2999a41ab12349288d9.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_056548d84bf5d2999a41ab12349288d9.jpg saved to cache
2025-12-05 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3726a50>
2025-12-05 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_5eabbdd7df897b49ae6971302ff62e66.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_5eabbdd7df897b49ae6971302ff62e66.jpg saved to cache
2025-12-05 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e51de6e5-fa1b-589f-b583-8a3456c991e1 with identifier: DB02360
2025-12-05 20:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e51de6e5-fa1b-589f-b583-8a3456c991e1 with scrape type 2
2025-12-05 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e51de6e5-fa1b-589f-b583-8a3456c991e1 with scrape type 2
2025-12-05 20:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e51de6e5-fa1b-589f-b583-8a3456c991e1, identifier: DB02360
2025-12-05 20:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51d55bdc-dec8-5559-983d-ad4bc2375a50 with identifier: DU65956
2025-12-05 20:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51d55bdc-dec8-5559-983d-ad4bc2375a50 with scrape type 2
2025-12-05 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51d55bdc-dec8-5559-983d-ad4bc2375a50 with scrape type 2
2025-12-05 20:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 51d55bdc-dec8-5559-983d-ad4bc2375a50, identifier: DU65956
2025-12-05 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_0ccfc342522d0a8779aa57ef90a0daab.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e51de6e5-fa1b-589f-b583-8a3456c991e1 with identifier: DB02360
2025-12-05 20:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e51de6e5-fa1b-589f-b583-8a3456c991e1 with identifier: DB02360
2025-12-05 20:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181804 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181804
2025-12-05 20:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e51de6e5-fa1b-589f-b583-8a3456c991e1 spider: auto1.it
2025-12-05 20:06:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e51de6e5-fa1b-589f-b583-8a3456c991e1 due to rule: high_mileage_for_country.json, error: 181804 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181804
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-06T16:26:58Z',
 'fuel_type': 'diesel',
 'id': 'e51de6e5-fa1b-589f-b583-8a3456c991e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB02360',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 181804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XE 25d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2018}
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB02360%27 HTTP/1.1" 200 None
2025-12-05 20:06:51 [auto1.it] INFO: Saving data for DB02360: {'auction_closing_time': 1765038418.0, 'created_time': 1762286686.637801, 'last_price_update_time': 1764965211.596524}
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DB02360') HTTP/1.1" 204 0
2025-12-05 20:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 51d55bdc-dec8-5559-983d-ad4bc2375a50 with identifier: DU65956
2025-12-05 20:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 51d55bdc-dec8-5559-983d-ad4bc2375a50 with identifier: DU65956
2025-12-05 20:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 51d55bdc-dec8-5559-983d-ad4bc2375a50 with identifier: DU65956 to the API
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU65956>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:22:50Z',
 'fuel_type': 'diesel',
 'id': '51d55bdc-dec8-5559-983d-ad4bc2375a50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU65956',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 65491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2021}
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU65956%27 HTTP/1.1" 200 None
2025-12-05 20:06:51 [auto1.it] INFO: Saving data for DU65956: {'auction_closing_time': 1765038170.0, 'created_time': 1764015108.998732, 'last_price_update_time': 1764965211.961099}
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU65956') HTTP/1.1" 204 0
2025-12-05 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_882ddd1a412d27ad203ed3a5a8d05af0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_4a8cd38dc0338af13ac7dae8a3514fcb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_93f8921260b4dfb7601b67cb13c1f43f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_32a1563e6b2e96cc38561976ef9df7a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_32a1563e6b2e96cc38561976ef9df7a4.jpg not downloaded yet
2025-12-05 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47b6f8d5d4f7447ad703b6ecc2215454.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_c81f9f517a8554434791cd66a1a9cbee.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ61558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW11574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR71771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW18274> (referer: https://www.auto1.com/v1/car-details-view/VW18274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_bdb5c2073b7e5ebc993100545760235e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_bdb5c2073b7e5ebc993100545760235e.jpg not downloaded yet
2025-12-05 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0059e90>
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_0ccfc342522d0a8779aa57ef90a0daab.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_0ccfc342522d0a8779aa57ef90a0daab.jpg saved to cache
2025-12-05 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_164e733943e51ccad6dd838356ae95fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_164e733943e51ccad6dd838356ae95fc.jpg not downloaded yet
2025-12-05 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e1134f0d4096e09ccc41bc92f4f01cc1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3640290>
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_882ddd1a412d27ad203ed3a5a8d05af0.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_882ddd1a412d27ad203ed3a5a8d05af0.jpg saved to cache
2025-12-05 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae045db50>
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_4a8cd38dc0338af13ac7dae8a3514fcb.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_4a8cd38dc0338af13ac7dae8a3514fcb.jpg saved to cache
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae06357d0>
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_93f8921260b4dfb7601b67cb13c1f43f.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_93f8921260b4dfb7601b67cb13c1f43f.jpg saved to cache
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00d4650>
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_47b6f8d5d4f7447ad703b6ecc2215454.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47b6f8d5d4f7447ad703b6ecc2215454.jpg saved to cache
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a9510>
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_c81f9f517a8554434791cd66a1a9cbee.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_c81f9f517a8554434791cd66a1a9cbee.jpg saved to cache
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274
2025-12-05 20:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with scrape type 1
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_57dd3eac8105f69c79883f0bbae9136d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_57dd3eac8105f69c79883f0bbae9136d.jpg not downloaded yet
2025-12-05 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_2dc3ee13d773e51f06399a3a3d3b557f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_59164ac09c1a4b8bf913e3c1e6bff9ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_c7be1adde157477045f8a4e365596de4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c7be1adde157477045f8a4e365596de4.jpg not downloaded yet
2025-12-05 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_f4274c02e19af91ed2e0e12ea530903d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_6c62f5f0d2edd2c1b4e9a5f891042a52.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_9b262dbe24a0203b8fa4e5b9b42751b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_67d4a6a370d6da9b097c3fec1e4ab7b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_67d4a6a370d6da9b097c3fec1e4ab7b0.jpg not downloaded yet
2025-12-05 20:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_32a1563e6b2e96cc38561976ef9df7a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_3211822d6f8d90dcb068e04ef888f875.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_3211822d6f8d90dcb068e04ef888f875.jpg not downloaded yet
2025-12-05 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ28194/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA30496> (referer: https://www.auto1.com/v1/car-details-view/FA30496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU66425/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX66152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0451690>
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_e1134f0d4096e09ccc41bc92f4f01cc1.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e1134f0d4096e09ccc41bc92f4f01cc1.jpg saved to cache
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_feaf76345e4785897bb1d4356cd53758.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_feaf76345e4785897bb1d4356cd53758.jpg not downloaded yet
2025-12-05 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_bdb5c2073b7e5ebc993100545760235e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_e7d4ad96c772c34aacc9ab027ea9c5f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e7d4ad96c772c34aacc9ab027ea9c5f1.jpg not downloaded yet
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a0b10>
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_2dc3ee13d773e51f06399a3a3d3b557f.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_2dc3ee13d773e51f06399a3a3d3b557f.jpg saved to cache
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02fadd0>
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_59164ac09c1a4b8bf913e3c1e6bff9ba.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_59164ac09c1a4b8bf913e3c1e6bff9ba.jpg saved to cache
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_164e733943e51ccad6dd838356ae95fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_50c2ff24bd5e013d1be71a99820f834a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_01c3ad2021cdb68ff47b886a9bc866e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_01c3ad2021cdb68ff47b886a9bc866e7.jpg not downloaded yet
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b9010>
2025-12-05 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_f4274c02e19af91ed2e0e12ea530903d.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_f4274c02e19af91ed2e0e12ea530903d.jpg saved to cache
2025-12-05 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0075f10>
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_6c62f5f0d2edd2c1b4e9a5f891042a52.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_6c62f5f0d2edd2c1b4e9a5f891042a52.jpg saved to cache
2025-12-05 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0426f50>
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_9b262dbe24a0203b8fa4e5b9b42751b3.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_9b262dbe24a0203b8fa4e5b9b42751b3.jpg saved to cache
2025-12-05 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e5a90>
2025-12-05 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_32a1563e6b2e96cc38561976ef9df7a4.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_32a1563e6b2e96cc38561976ef9df7a4.jpg saved to cache
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59863eec-1195-59b9-8d72-7808742ebdd4 with identifier: FA30496
2025-12-05 20:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59863eec-1195-59b9-8d72-7808742ebdd4 with scrape type 1
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 59863eec-1195-59b9-8d72-7808742ebdd4
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_48e9d91b112c282fd80ebe76f060f458.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_48e9d91b112c282fd80ebe76f060f458.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_48882abf7a5f2451dbf6beac0f636f2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_48882abf7a5f2451dbf6beac0f636f2a.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_bc732f953ea57744e33e7757a239f4d2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_bc732f953ea57744e33e7757a239f4d2.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_22f406759725c7e8d9262151ad2df9fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_22f406759725c7e8d9262151ad2df9fa.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_096df424807401e20abe4412ceca5233.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_096df424807401e20abe4412ceca5233.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_6e5a49e01fd2ae2ca42675f207c53988.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_6e5a49e01fd2ae2ca42675f207c53988.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_0db6b601d332037923abee6d6c03980d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_0db6b601d332037923abee6d6c03980d.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_6f1816400f1a7b5f2d6f1803af0b9458.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_6f1816400f1a7b5f2d6f1803af0b9458.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_5d13306b422b10a77abef1fed8e7b440.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_5d13306b422b10a77abef1fed8e7b440.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_66580cc689529477e14b254ce9125eb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_66580cc689529477e14b254ce9125eb3.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_760d64f92f9d33859f4f3676325b87d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_760d64f92f9d33859f4f3676325b87d9.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_4cf511f2c3824a8632c21446ae2c77f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_4cf511f2c3824a8632c21446ae2c77f6.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_5541e34b687707ae1e3cf31d78d0371a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_5541e34b687707ae1e3cf31d78d0371a.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_f5dbe231104d4a606d35e50749a6c0f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_f5dbe231104d4a606d35e50749a6c0f8.jpg already downloaded
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F02%252Fb30283008481980152251880a51d3200%252Fpa%252FFA30496_0ff81cde44a2148f7695d56ad8204402.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_0ff81cde44a2148f7695d56ad8204402.jpg already downloaded
2025-12-05 20:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 59863eec-1195-59b9-8d72-7808742ebdd4, identifier: FA30496
2025-12-05 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_57dd3eac8105f69c79883f0bbae9136d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_fa1b12f2beb4c251bc12b767da2d9e54.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_fa1b12f2beb4c251bc12b767da2d9e54.jpg not downloaded yet
2025-12-05 20:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 59863eec-1195-59b9-8d72-7808742ebdd4 with identifier: FA30496
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2025-12-05 20:06:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 59863eec-1195-59b9-8d72-7808742ebdd4 with identifier: FA30496
2025-12-05 20:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 59863eec-1195-59b9-8d72-7808742ebdd4 with identifier: FA30496 to the API
2025-12-05 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FA30496>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-06T16:30:38Z',
 'fuel_type': 'diesel',
 'id': '59863eec-1195-59b9-8d72-7808742ebdd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA30496',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 68434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_48e9d91b112c282fd80ebe76f060f458.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_48882abf7a5f2451dbf6beac0f636f2a.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_bc732f953ea57744e33e7757a239f4d2.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_22f406759725c7e8d9262151ad2df9fa.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_096df424807401e20abe4412ceca5233.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_6e5a49e01fd2ae2ca42675f207c53988.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_0db6b601d332037923abee6d6c03980d.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_6f1816400f1a7b5f2d6f1803af0b9458.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_5d13306b422b10a77abef1fed8e7b440.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_66580cc689529477e14b254ce9125eb3.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_760d64f92f9d33859f4f3676325b87d9.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_4cf511f2c3824a8632c21446ae2c77f6.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_5541e34b687707ae1e3cf31d78d0371a.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_f5dbe231104d4a606d35e50749a6c0f8.jpg',
                'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_0ff81cde44a2148f7695d56ad8204402.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_48e9d91b112c282fd80ebe76f060f458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_48882abf7a5f2451dbf6beac0f636f2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_bc732f953ea57744e33e7757a239f4d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_22f406759725c7e8d9262151ad2df9fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_096df424807401e20abe4412ceca5233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_6e5a49e01fd2ae2ca42675f207c53988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_0db6b601d332037923abee6d6c03980d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_6f1816400f1a7b5f2d6f1803af0b9458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_5d13306b422b10a77abef1fed8e7b440.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_66580cc689529477e14b254ce9125eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_760d64f92f9d33859f4f3676325b87d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_4cf511f2c3824a8632c21446ae2c77f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_5541e34b687707ae1e3cf31d78d0371a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_f5dbe231104d4a606d35e50749a6c0f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59863eec-1195-59b9-8d72-7808742ebdd4/59863eec-1195-59b9-8d72-7808742ebdd4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/02/b30283008481980152251880a51d3200/pa/FA30496_0ff81cde44a2148f7695d56ad8204402.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA30496%27 HTTP/1.1" 200 None
2025-12-05 20:06:57 [auto1.it] INFO: Saving data for FA30496: {'created_time': 1764965217.169885, 'last_price_update_time': 1764965217.169894, 'auction_closing_time': 1765038638.0}
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FA30496') HTTP/1.1" 204 0
2025-12-05 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c7be1adde157477045f8a4e365596de4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_0fe9282f748125fb1b43aef51d75d455.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_0fe9282f748125fb1b43aef51d75d455.jpg not downloaded yet
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05860d0>
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_bdb5c2073b7e5ebc993100545760235e.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_bdb5c2073b7e5ebc993100545760235e.jpg saved to cache
2025-12-05 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_67d4a6a370d6da9b097c3fec1e4ab7b0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_c0107189afa24b9cb399d2f814812430.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c0107189afa24b9cb399d2f814812430.jpg not downloaded yet
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00f7490>
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_164e733943e51ccad6dd838356ae95fc.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_164e733943e51ccad6dd838356ae95fc.jpg saved to cache
2025-12-05 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae032b050>
2025-12-05 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_50c2ff24bd5e013d1be71a99820f834a.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_50c2ff24bd5e013d1be71a99820f834a.jpg saved to cache
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_feaf76345e4785897bb1d4356cd53758.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_3211822d6f8d90dcb068e04ef888f875.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_9eb01defc8f58cd0b3bef67c9653df35.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_9eb01defc8f58cd0b3bef67c9653df35.jpg not downloaded yet
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05d9590>
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_57dd3eac8105f69c79883f0bbae9136d.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_57dd3eac8105f69c79883f0bbae9136d.jpg saved to cache
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_7a60cf88836b8f221565add771b95002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_7a60cf88836b8f221565add771b95002.jpg not downloaded yet
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0064550>
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_c7be1adde157477045f8a4e365596de4.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c7be1adde157477045f8a4e365596de4.jpg saved to cache
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e7d4ad96c772c34aacc9ab027ea9c5f1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_8c7771abdfdb19a400e7c06786d90ee8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8c7771abdfdb19a400e7c06786d90ee8.jpg not downloaded yet
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3710050>
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_67d4a6a370d6da9b097c3fec1e4ab7b0.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_67d4a6a370d6da9b097c3fec1e4ab7b0.jpg saved to cache
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_eb880db0c1a417b81fcc9b649e4154e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_eb880db0c1a417b81fcc9b649e4154e5.jpg not downloaded yet
2025-12-05 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR71771> (referer: https://www.auto1.com/v1/car-details-view/NR71771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW14476> (referer: https://www.auto1.com/v1/car-details-view/AW14476/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3611690>
2025-12-05 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_feaf76345e4785897bb1d4356cd53758.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_feaf76345e4785897bb1d4356cd53758.jpg saved to cache
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0602190>
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_3211822d6f8d90dcb068e04ef888f875.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_3211822d6f8d90dcb068e04ef888f875.jpg saved to cache
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_0fe9282f748125fb1b43aef51d75d455.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_fa1b12f2beb4c251bc12b767da2d9e54.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_b372d0dbad6b5ad4b7b1e7719309d198.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_b372d0dbad6b5ad4b7b1e7719309d198.jpg not downloaded yet
2025-12-05 20:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_0db9494d30c839f241810408c28f77a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_0db9494d30c839f241810408c28f77a4.jpg not downloaded yet
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a5e50>
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_e7d4ad96c772c34aacc9ab027ea9c5f1.jpg') HTTP/1.1" 204 0
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e7d4ad96c772c34aacc9ab027ea9c5f1.jpg saved to cache
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_c7c64865c4407fe6ac07e3c54a025a07.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c7c64865c4407fe6ac07e3c54a025a07.jpg not downloaded yet
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ61558> (referer: https://www.auto1.com/v1/car-details-view/YZ61558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD68470> (referer: https://www.auto1.com/v1/car-details-view/HD68470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS22846> (referer: https://www.auto1.com/v1/car-details-view/FS22846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW11574> (referer: https://www.auto1.com/v1/car-details-view/YW11574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ94683> (referer: https://www.auto1.com/v1/car-details-view/ZZ94683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY98220> (referer: https://www.auto1.com/v1/car-details-view/BY98220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e6abaa-80f0-577c-bc53-14a44fcb9d70 with identifier: NR71771
2025-12-05 20:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e6abaa-80f0-577c-bc53-14a44fcb9d70 with scrape type 2
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e6abaa-80f0-577c-bc53-14a44fcb9d70 with scrape type 2
2025-12-05 20:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1e6abaa-80f0-577c-bc53-14a44fcb9d70, identifier: NR71771
2025-12-05 20:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d with identifier: AW14476
2025-12-05 20:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d with scrape type 2
2025-12-05 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d with scrape type 2
2025-12-05 20:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d, identifier: AW14476
2025-12-05 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1e6abaa-80f0-577c-bc53-14a44fcb9d70 with identifier: NR71771
2025-12-05 20:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1e6abaa-80f0-577c-bc53-14a44fcb9d70 with identifier: NR71771
2025-12-05 20:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1e6abaa-80f0-577c-bc53-14a44fcb9d70 with identifier: NR71771 to the API
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NR71771>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 261,
 'expiration_date': '2025-12-06T16:19:57Z',
 'fuel_type': 'hybrid',
 'id': 'f1e6abaa-80f0-577c-bc53-14a44fcb9d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR71771',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 83390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription Expression 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2020}
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR71771%27 HTTP/1.1" 200 None
2025-12-05 20:07:00 [auto1.it] INFO: Saving data for NR71771: {'auction_closing_time': 1765037997.0, 'created_time': 1762977716.289826, 'last_price_update_time': 1764965220.504069}
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR71771') HTTP/1.1" 204 0
2025-12-05 20:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d with identifier: AW14476
2025-12-05 20:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d with identifier: AW14476
2025-12-05 20:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158451 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158451
2025-12-05 20:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d spider: auto1.it
2025-12-05 20:07:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d due to rule: high_mileage_for_country.json, error: 158451 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158451
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:46:45Z',
 'fuel_type': 'diesel',
 'id': 'f0fbbbf7-19dc-5d2e-8e54-e12a50efa01d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW14476',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 158451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Business BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business BlueMotion',
 'year': 2018}
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW14476%27 HTTP/1.1" 200 None
2025-12-05 20:07:00 [auto1.it] INFO: Saving data for AW14476: {'auction_closing_time': 1765039605.0, 'created_time': 1762934467.523292, 'last_price_update_time': 1764965220.75808}
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW14476') HTTP/1.1" 204 0
2025-12-05 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8c7771abdfdb19a400e7c06786d90ee8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_9eb01defc8f58cd0b3bef67c9653df35.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_d8fc0176adf87be423bfb8177129d121.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_d8fc0176adf87be423bfb8177129d121.jpg not downloaded yet
2025-12-05 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02ed890>
2025-12-05 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_0fe9282f748125fb1b43aef51d75d455.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_0fe9282f748125fb1b43aef51d75d455.jpg saved to cache
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0254e50>
2025-12-05 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_fa1b12f2beb4c251bc12b767da2d9e54.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_fa1b12f2beb4c251bc12b767da2d9e54.jpg saved to cache
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_7a60cf88836b8f221565add771b95002.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c0107189afa24b9cb399d2f814812430.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_c22fb6b328650c67a4f883ebc5f5a9c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c22fb6b328650c67a4f883ebc5f5a9c0.jpg not downloaded yet
2025-12-05 20:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458b0baf-11e0-5537-ab1f-80f2cbe3ec41 with identifier: YZ61558
2025-12-05 20:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458b0baf-11e0-5537-ab1f-80f2cbe3ec41 with scrape type 2
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458b0baf-11e0-5537-ab1f-80f2cbe3ec41 with scrape type 2
2025-12-05 20:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 458b0baf-11e0-5537-ab1f-80f2cbe3ec41, identifier: YZ61558
2025-12-05 20:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f4ddb5-1f94-542a-ac72-2d0600a07556 with identifier: HD68470
2025-12-05 20:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f4ddb5-1f94-542a-ac72-2d0600a07556 with scrape type 1
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_8d305f961921dcf3c5b24745cb11e468.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_8d305f961921dcf3c5b24745cb11e468.jpg not downloaded yet
2025-12-05 20:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f7fa3d1-db67-5b3d-9b86-84b097e9d50b with identifier: FS22846
2025-12-05 20:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f7fa3d1-db67-5b3d-9b86-84b097e9d50b with scrape type 2
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f7fa3d1-db67-5b3d-9b86-84b097e9d50b with scrape type 2
2025-12-05 20:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f7fa3d1-db67-5b3d-9b86-84b097e9d50b, identifier: FS22846
2025-12-05 20:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392e894e-9fd3-5d0a-a028-8e197a5cdd79 with identifier: YW11574
2025-12-05 20:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392e894e-9fd3-5d0a-a028-8e197a5cdd79 with scrape type 2
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 392e894e-9fd3-5d0a-a028-8e197a5cdd79 with scrape type 2
2025-12-05 20:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 392e894e-9fd3-5d0a-a028-8e197a5cdd79, identifier: YW11574
2025-12-05 20:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a01a9f7-3120-50a5-90cb-29e183ee3611 with identifier: ZZ94683
2025-12-05 20:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a01a9f7-3120-50a5-90cb-29e183ee3611 with scrape type 1
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_0f6998a62c6b1bdf8ebdc014f87a386c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0f6998a62c6b1bdf8ebdc014f87a386c.jpg not downloaded yet
2025-12-05 20:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220
2025-12-05 20:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56423a48-20c0-5784-b301-2669b752030a with scrape type 1
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_277f3129b248a60aa8cecc1d2708d043.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_277f3129b248a60aa8cecc1d2708d043.jpg not downloaded yet
2025-12-05 20:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 458b0baf-11e0-5537-ab1f-80f2cbe3ec41 with identifier: YZ61558
2025-12-05 20:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 458b0baf-11e0-5537-ab1f-80f2cbe3ec41 with identifier: YZ61558
2025-12-05 20:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 458b0baf-11e0-5537-ab1f-80f2cbe3ec41 with identifier: YZ61558 to the API
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YZ61558>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:14:52Z',
 'fuel_type': 'diesel',
 'id': '458b0baf-11e0-5537-ab1f-80f2cbe3ec41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ61558',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 144926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ61558%27 HTTP/1.1" 200 None
2025-12-05 20:07:02 [auto1.it] INFO: Saving data for YZ61558: {'auction_closing_time': 1765037692.0, 'created_time': 1762286785.717317, 'last_price_update_time': 1764965222.294521}
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YZ61558') HTTP/1.1" 204 0
2025-12-05 20:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f7fa3d1-db67-5b3d-9b86-84b097e9d50b with identifier: FS22846
2025-12-05 20:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f7fa3d1-db67-5b3d-9b86-84b097e9d50b with identifier: FS22846
2025-12-05 20:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f7fa3d1-db67-5b3d-9b86-84b097e9d50b with identifier: FS22846 to the API
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FS22846>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:03:53Z',
 'fuel_type': 'diesel',
 'id': '3f7fa3d1-db67-5b3d-9b86-84b097e9d50b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS22846',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 77545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS22846%27 HTTP/1.1" 200 None
2025-12-05 20:07:02 [auto1.it] INFO: Saving data for FS22846: {'auction_closing_time': 1765037033.0, 'created_time': 1762891533.023907, 'last_price_update_time': 1764965222.697136}
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FS22846') HTTP/1.1" 204 0
2025-12-05 20:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 392e894e-9fd3-5d0a-a028-8e197a5cdd79 with identifier: YW11574
2025-12-05 20:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 392e894e-9fd3-5d0a-a028-8e197a5cdd79 with identifier: YW11574
2025-12-05 20:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 392e894e-9fd3-5d0a-a028-8e197a5cdd79 with identifier: YW11574 to the API
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW11574>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:47:35Z',
 'fuel_type': 'diesel',
 'id': '392e894e-9fd3-5d0a-a028-8e197a5cdd79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW11574',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 37482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 BLUE dCi S-Edition',
 'transmission': 'manual',
 'trim': 'S-Edition',
 'year': 2019}
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW11574%27 HTTP/1.1" 200 None
2025-12-05 20:07:03 [auto1.it] INFO: Saving data for YW11574: {'auction_closing_time': 1765039655.0, 'created_time': 1764756109.606317, 'last_price_update_time': 1764965223.028179}
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW11574') HTTP/1.1" 204 0
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a8dd0>
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_8c7771abdfdb19a400e7c06786d90ee8.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8c7771abdfdb19a400e7c06786d90ee8.jpg saved to cache
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f1090>
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_9eb01defc8f58cd0b3bef67c9653df35.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_9eb01defc8f58cd0b3bef67c9653df35.jpg saved to cache
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_01c3ad2021cdb68ff47b886a9bc866e7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_2fc7a2df13d7f52c3a7bfe38d685f8fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_2fc7a2df13d7f52c3a7bfe38d685f8fc.jpg not downloaded yet
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_de7ed9241f63f40fc14cbedc9e19e2b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_de7ed9241f63f40fc14cbedc9e19e2b6.jpg not downloaded yet
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_8d7c71ada34e3c2ff38ebd7cc1c35447.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8d7c71ada34e3c2ff38ebd7cc1c35447.jpg not downloaded yet
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_68662d7da7c1a816facaa364c6ad52b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_68662d7da7c1a816facaa364c6ad52b2.jpg not downloaded yet
2025-12-05 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_b372d0dbad6b5ad4b7b1e7719309d198.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c7c64865c4407fe6ac07e3c54a025a07.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_0db9494d30c839f241810408c28f77a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_eb880db0c1a417b81fcc9b649e4154e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ40954> (referer: https://www.auto1.com/v1/car-details-view/CZ40954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX66152> (referer: https://www.auto1.com/v1/car-details-view/KX66152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f6b50>
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_7a60cf88836b8f221565add771b95002.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_7a60cf88836b8f221565add771b95002.jpg saved to cache
2025-12-05 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3643e10>
2025-12-05 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_c0107189afa24b9cb399d2f814812430.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c0107189afa24b9cb399d2f814812430.jpg saved to cache
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_f544238788a599d377d99f82e604c327.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_f544238788a599d377d99f82e604c327.jpg not downloaded yet
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_4967e25b3caf1805bf2c9486104f2f18.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_4967e25b3caf1805bf2c9486104f2f18.jpg not downloaded yet
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_f6aa9bfbc0ac40798a368c85964a1969.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_f6aa9bfbc0ac40798a368c85964a1969.jpg not downloaded yet
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_a6081891cf5379941f08503d280572ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_a6081891cf5379941f08503d280572ef.jpg not downloaded yet
2025-12-05 20:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3610690>
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_01c3ad2021cdb68ff47b886a9bc866e7.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_01c3ad2021cdb68ff47b886a9bc866e7.jpg saved to cache
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_23057fcff810a1f4f704eb268a327a85.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_23057fcff810a1f4f704eb268a327a85.jpg not downloaded yet
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_ea424d09942a319784a5af1f37af28b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ea424d09942a319784a5af1f37af28b6.jpg not downloaded yet
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_807f71d29159354e58675e67bd4475de.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_807f71d29159354e58675e67bd4475de.jpg not downloaded yet
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_1fc8fdae261e391af775f39cee9faf6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_1fc8fdae261e391af775f39cee9faf6c.jpg not downloaded yet
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e6110>
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_b372d0dbad6b5ad4b7b1e7719309d198.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_b372d0dbad6b5ad4b7b1e7719309d198.jpg saved to cache
2025-12-05 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0471c50>
2025-12-05 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_c7c64865c4407fe6ac07e3c54a025a07.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c7c64865c4407fe6ac07e3c54a025a07.jpg saved to cache
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d6fd0>
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_0db9494d30c839f241810408c28f77a4.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_0db9494d30c839f241810408c28f77a4.jpg saved to cache
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363fe90>
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2a%252F4f2a2ec20a81876f630b2321e9f027c8%252Fpa%252FNM32123_eb880db0c1a417b81fcc9b649e4154e5.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_eb880db0c1a417b81fcc9b649e4154e5.jpg saved to cache
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 133a6ce1-7451-5af5-a6c4-ab315235ef39
2025-12-05 20:07:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 133a6ce1-7451-5af5-a6c4-ab315235ef39, skipping ID generation
2025-12-05 20:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133a6ce1-7451-5af5-a6c4-ab315235ef39 with scrape type 1
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 133a6ce1-7451-5af5-a6c4-ab315235ef39 from tracking dictionaries
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 133a6ce1-7451-5af5-a6c4-ab315235ef39 sending to next pipeline
2025-12-05 20:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 133a6ce1-7451-5af5-a6c4-ab315235ef39, identifier: NM32123
2025-12-05 20:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55fd231b-2d9d-5fb0-b03d-937fafb498f8 with identifier: CZ40954
2025-12-05 20:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8 with scrape type 1
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_9789988db815afe0893aac252bdaaa80.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_9789988db815afe0893aac252bdaaa80.jpg not downloaded yet
2025-12-05 20:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b95a5cbb-6e79-52d4-9491-12a6f72f09ca with identifier: KX66152
2025-12-05 20:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b95a5cbb-6e79-52d4-9491-12a6f72f09ca with scrape type 2
2025-12-05 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b95a5cbb-6e79-52d4-9491-12a6f72f09ca with scrape type 2
2025-12-05 20:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b95a5cbb-6e79-52d4-9491-12a6f72f09ca, identifier: KX66152
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c22fb6b328650c67a4f883ebc5f5a9c0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_d8fc0176adf87be423bfb8177129d121.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 133a6ce1-7451-5af5-a6c4-ab315235ef39 with identifier: NM32123
2025-12-05 20:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 133a6ce1-7451-5af5-a6c4-ab315235ef39 with identifier: NM32123
2025-12-05 20:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152003 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152003
2025-12-05 20:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 133a6ce1-7451-5af5-a6c4-ab315235ef39 spider: auto1.it
2025-12-05 20:07:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 133a6ce1-7451-5af5-a6c4-ab315235ef39 due to rule: high_mileage_for_country.json, error: 152003 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152003
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:12:19Z',
 'fuel_type': 'diesel',
 'id': '133a6ce1-7451-5af5-a6c4-ab315235ef39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM32123',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 152003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_f4274c02e19af91ed2e0e12ea530903d.jpg',
             'Width': 776},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e1134f0d4096e09ccc41bc92f4f01cc1.jpg',
             'Width': 776},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_2dc3ee13d773e51f06399a3a3d3b557f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_32a1563e6b2e96cc38561976ef9df7a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_bdb5c2073b7e5ebc993100545760235e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_164e733943e51ccad6dd838356ae95fc.jpg',
             'Width': 733},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c7be1adde157477045f8a4e365596de4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_3211822d6f8d90dcb068e04ef888f875.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_e7d4ad96c772c34aacc9ab027ea9c5f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_fa1b12f2beb4c251bc12b767da2d9e54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_c0107189afa24b9cb399d2f814812430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_7a60cf88836b8f221565add771b95002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_eb880db0c1a417b81fcc9b649e4154e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_133a6ce1-7451-5af5-a6c4-ab315235ef39/133a6ce1-7451-5af5-a6c4-ab315235ef39_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2a/4f2a2ec20a81876f630b2321e9f027c8/pa/NM32123_0db9494d30c839f241810408c28f77a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Business',
 'transmission': 'automatic',
 'trim': '4Matic Business',
 'year': 2018}
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM32123%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [auto1.it] INFO: Saving data for NM32123: {'created_time': 1764965226.334664, 'last_price_update_time': 1764965226.334674, 'auction_closing_time': 1765037539.0}
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NM32123') HTTP/1.1" 204 0
2025-12-05 20:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b95a5cbb-6e79-52d4-9491-12a6f72f09ca with identifier: KX66152
2025-12-05 20:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b95a5cbb-6e79-52d4-9491-12a6f72f09ca with identifier: KX66152
2025-12-05 20:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b95a5cbb-6e79-52d4-9491-12a6f72f09ca with identifier: KX66152 to the API
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KX66152>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': 'Rental',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.8L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:29:56Z',
 'fuel_type': 'diesel',
 'id': 'b95a5cbb-6e79-52d4-9491-12a6f72f09ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX66152',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 146470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-30 1.8 D Exceed 2WD',
 'transmission': 'manual',
 'trim': 'Exceed 2WD',
 'year': 2020}
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX66152%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [auto1.it] INFO: Saving data for KX66152: {'auction_closing_time': 1765038596.0, 'created_time': 1762286734.396229, 'last_price_update_time': 1764965226.727481}
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KX66152') HTTP/1.1" 204 0
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_277f3129b248a60aa8cecc1d2708d043.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_8f9faf5698b69680e91d37df78b8e0b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8f9faf5698b69680e91d37df78b8e0b6.jpg not downloaded yet
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_f7405ee4e99a27316e0ba41a439b8565.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_f7405ee4e99a27316e0ba41a439b8565.jpg not downloaded yet
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_2421a5bd779f9c8918a16beada737e92.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_2421a5bd779f9c8918a16beada737e92.jpg not downloaded yet
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_b296ac9ee3d910d7110abd169f08b861.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_b296ac9ee3d910d7110abd169f08b861.jpg not downloaded yet
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_f01d70d337f4b616161f0f6eb86eb8a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_f01d70d337f4b616161f0f6eb86eb8a7.jpg not downloaded yet
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ28194> (referer: https://www.auto1.com/v1/car-details-view/GZ28194/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU66425> (referer: https://www.auto1.com/v1/car-details-view/GU66425/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB92069> (referer: https://www.auto1.com/v1/car-details-view/UB92069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_68662d7da7c1a816facaa364c6ad52b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM04068> (referer: https://www.auto1.com/v1/car-details-view/KM04068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG58363> (referer: https://www.auto1.com/v1/car-details-view/GG58363/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB86723> (referer: https://www.auto1.com/v1/car-details-view/JB86723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_62b521f77d82ab8d92e56c340db7628a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_1e313b44be6bb3f7abc4c7cc6731e24d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_1e313b44be6bb3f7abc4c7cc6731e24d.jpg not downloaded yet
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_ea959487d7fe47a948de36fd9ed090ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_ea959487d7fe47a948de36fd9ed090ed.jpg not downloaded yet
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_0f8fb0f044e8149ea4eb856ccfe091ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0f8fb0f044e8149ea4eb856ccfe091ff.jpg not downloaded yet
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_00c8ea07f4c1bf1f62b6e99337badb06.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_00c8ea07f4c1bf1f62b6e99337badb06.jpg not downloaded yet
2025-12-05 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_8d305f961921dcf3c5b24745cb11e468.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0536e90>
2025-12-05 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_c22fb6b328650c67a4f883ebc5f5a9c0.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c22fb6b328650c67a4f883ebc5f5a9c0.jpg saved to cache
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0536e10>
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_d8fc0176adf87be423bfb8177129d121.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_d8fc0176adf87be423bfb8177129d121.jpg saved to cache
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00641d0>
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_277f3129b248a60aa8cecc1d2708d043.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_277f3129b248a60aa8cecc1d2708d043.jpg saved to cache
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_67c6a558fc890f2ec43c121f21e83744.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_67c6a558fc890f2ec43c121f21e83744.jpg not downloaded yet
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_186a179e81fedf33aa6f7461b8dd4951.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_186a179e81fedf33aa6f7461b8dd4951.jpg not downloaded yet
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_6d29e2343330c12c96e982ed027fc4da.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_6d29e2343330c12c96e982ed027fc4da.jpg not downloaded yet
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_656b15109a5c2307bab97711ebb6c39a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_656b15109a5c2307bab97711ebb6c39a.jpg not downloaded yet
2025-12-05 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_1fc8fdae261e391af775f39cee9faf6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_23057fcff810a1f4f704eb268a327a85.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_807f71d29159354e58675e67bd4475de.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_90ab1b540f5972f8d552d2e8de826959.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_90ab1b540f5972f8d552d2e8de826959.jpg not downloaded yet
2025-12-05 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_0e626d646dab4ea55a8d4bdb387dce12.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0e626d646dab4ea55a8d4bdb387dce12.jpg not downloaded yet
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_7890be9f92521c31ae11ed18e13eab61.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_7890be9f92521c31ae11ed18e13eab61.jpg not downloaded yet
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_7d00a60af1048fb0a448443238f300b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_7d00a60af1048fb0a448443238f300b1.jpg not downloaded yet
2025-12-05 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b95ab8-9a88-5120-9ad6-519f4f4e69b0 with identifier: GZ28194
2025-12-05 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b95ab8-9a88-5120-9ad6-519f4f4e69b0 with scrape type 1
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 55b95ab8-9a88-5120-9ad6-519f4f4e69b0
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_6683db5c8fc832283101d9d13d2859e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_6683db5c8fc832283101d9d13d2859e0.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_04c2779fe7a7c807a8f6682171259b88.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_04c2779fe7a7c807a8f6682171259b88.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_11f5302e4ec95de11b58de22f817aaaf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_11f5302e4ec95de11b58de22f817aaaf.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_d350cba1d68cad14da738ebf2d5bd208.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_d350cba1d68cad14da738ebf2d5bd208.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_1c0d1c5fa418c59590ed35ea6e3f17be.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_1c0d1c5fa418c59590ed35ea6e3f17be.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_43eb884cf02b7e1f95f34d610b99100f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_43eb884cf02b7e1f95f34d610b99100f.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_a1e6a58966290169cdd5ec57bb5af869.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_a1e6a58966290169cdd5ec57bb5af869.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_fd7f067dc4b669050a7fa36c10d7a43b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_fd7f067dc4b669050a7fa36c10d7a43b.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_06b191b40549cb1326bfd7e618c007cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_06b191b40549cb1326bfd7e618c007cf.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_399cfe395925cb1bac92b37f6b1e2c51.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_399cfe395925cb1bac92b37f6b1e2c51.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_df8a9a7f31e967104cc4168f7b7512dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_df8a9a7f31e967104cc4168f7b7512dc.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_ec5f1d9b5e338b185406005a2a6f5655.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_ec5f1d9b5e338b185406005a2a6f5655.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_533a9bff664a3d9fa28bab8d8d962da2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_533a9bff664a3d9fa28bab8d8d962da2.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_e7244c06dff2dd33d5256b760cae5289.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_e7244c06dff2dd33d5256b760cae5289.jpg already downloaded
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fa9%252F1ea906463b412c94497521e919dbbb88%252Fpa%252FGZ28194_f331500dfbb65f2be572c75e41eef0a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_f331500dfbb65f2be572c75e41eef0a8.jpg already downloaded
2025-12-05 20:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55b95ab8-9a88-5120-9ad6-519f4f4e69b0, identifier: GZ28194
2025-12-05 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c47547bb-18ad-57f6-a563-e57ea491a707 with identifier: GU66425
2025-12-05 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47547bb-18ad-57f6-a563-e57ea491a707 with scrape type 1
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_960eb0bbb34c271064265c620edb58b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_960eb0bbb34c271064265c620edb58b9.jpg not downloaded yet
2025-12-05 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 with identifier: UB92069
2025-12-05 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 with scrape type 1
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_87f9907a4a4489e84a2c048f3888c7f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_87f9907a4a4489e84a2c048f3888c7f9.jpg not downloaded yet
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad365a9d0>
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_68662d7da7c1a816facaa364c6ad52b2.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_68662d7da7c1a816facaa364c6ad52b2.jpg saved to cache
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adca4081-70b0-5e41-b802-6cdb91200aee with identifier: KM04068
2025-12-05 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adca4081-70b0-5e41-b802-6cdb91200aee with scrape type 1
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_7264fd63cb330d2f754bbd9572ac5311.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7264fd63cb330d2f754bbd9572ac5311.jpg not downloaded yet
2025-12-05 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b93a5d-8057-5653-9d42-b453f02d6587 with identifier: GG58363
2025-12-05 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b93a5d-8057-5653-9d42-b453f02d6587 with scrape type 1
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_11c92b288bdf090e72c79b66a68a4d0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_11c92b288bdf090e72c79b66a68a4d0f.jpg not downloaded yet
2025-12-05 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca0c369-123f-5db5-b94c-e77751c5fcb0 with identifier: JB86723
2025-12-05 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0 with scrape type 1
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_b889f0f2c596f1b47a337fee399396a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b889f0f2c596f1b47a337fee399396a4.jpg not downloaded yet
2025-12-05 20:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36b59d0>
2025-12-05 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_62b521f77d82ab8d92e56c340db7628a.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_62b521f77d82ab8d92e56c340db7628a.jpg saved to cache
2025-12-05 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36bb410>
2025-12-05 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_8d305f961921dcf3c5b24745cb11e468.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_8d305f961921dcf3c5b24745cb11e468.jpg saved to cache
2025-12-05 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55b95ab8-9a88-5120-9ad6-519f4f4e69b0 with identifier: GZ28194
2025-12-05 20:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55b95ab8-9a88-5120-9ad6-519f4f4e69b0 with identifier: GZ28194
2025-12-05 20:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187409 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187409
2025-12-05 20:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 55b95ab8-9a88-5120-9ad6-519f4f4e69b0 spider: auto1.it
2025-12-05 20:07:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 55b95ab8-9a88-5120-9ad6-519f4f4e69b0 due to rule: high_mileage_for_country.json, error: 187409 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187409
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:54:52Z',
 'fuel_type': 'diesel',
 'id': '55b95ab8-9a88-5120-9ad6-519f4f4e69b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ28194',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 187409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_6683db5c8fc832283101d9d13d2859e0.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_04c2779fe7a7c807a8f6682171259b88.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_11f5302e4ec95de11b58de22f817aaaf.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_d350cba1d68cad14da738ebf2d5bd208.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_1c0d1c5fa418c59590ed35ea6e3f17be.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_43eb884cf02b7e1f95f34d610b99100f.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_a1e6a58966290169cdd5ec57bb5af869.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_fd7f067dc4b669050a7fa36c10d7a43b.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_06b191b40549cb1326bfd7e618c007cf.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_399cfe395925cb1bac92b37f6b1e2c51.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_df8a9a7f31e967104cc4168f7b7512dc.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_ec5f1d9b5e338b185406005a2a6f5655.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_533a9bff664a3d9fa28bab8d8d962da2.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_e7244c06dff2dd33d5256b760cae5289.jpg',
                'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_f331500dfbb65f2be572c75e41eef0a8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_6683db5c8fc832283101d9d13d2859e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_04c2779fe7a7c807a8f6682171259b88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_11f5302e4ec95de11b58de22f817aaaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_d350cba1d68cad14da738ebf2d5bd208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_1c0d1c5fa418c59590ed35ea6e3f17be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_43eb884cf02b7e1f95f34d610b99100f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_a1e6a58966290169cdd5ec57bb5af869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_fd7f067dc4b669050a7fa36c10d7a43b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_06b191b40549cb1326bfd7e618c007cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_399cfe395925cb1bac92b37f6b1e2c51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_df8a9a7f31e967104cc4168f7b7512dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_ec5f1d9b5e338b185406005a2a6f5655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_533a9bff664a3d9fa28bab8d8d962da2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_e7244c06dff2dd33d5256b760cae5289.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b95ab8-9a88-5120-9ad6-519f4f4e69b0/55b95ab8-9a88-5120-9ad6-519f4f4e69b0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/a9/1ea906463b412c94497521e919dbbb88/pa/GZ28194_f331500dfbb65f2be572c75e41eef0a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ28194%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [auto1.it] INFO: Saving data for GZ28194: {'created_time': 1764965230.038454, 'last_price_update_time': 1764965230.038465, 'auction_closing_time': 1765040092.0}
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ28194') HTTP/1.1" 204 0
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_263190986fec4edb4cdf83ef9b4333a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_263190986fec4edb4cdf83ef9b4333a0.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_8cb010d796b2a8eb4ee2bc3558e06d95.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8cb010d796b2a8eb4ee2bc3558e06d95.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_181ad2cc7446b53652c447b04f80bd84.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_181ad2cc7446b53652c447b04f80bd84.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_1bc4ef3b275d9fbc69a663ef2efb78b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_1bc4ef3b275d9fbc69a663ef2efb78b9.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_d05b326bec075180e7f6171753fd93db.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_d05b326bec075180e7f6171753fd93db.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_923590fbadb8613dd7c249711a017f0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_923590fbadb8613dd7c249711a017f0a.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_d5d6a7ebdc27ca582d6fd3871e3c6b93.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d5d6a7ebdc27ca582d6fd3871e3c6b93.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d7a47856517d89a23abc30efeaed807c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d7a47856517d89a23abc30efeaed807c.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_5bf7c44e54cc629e270619f1bffd8e57.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_5bf7c44e54cc629e270619f1bffd8e57.jpg not downloaded yet
2025-12-05 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_9789988db815afe0893aac252bdaaa80.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ea424d09942a319784a5af1f37af28b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_a6081891cf5379941f08503d280572ef.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_f01d70d337f4b616161f0f6eb86eb8a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_9605fc6aff460b9f571b9165e9f2f567.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_9605fc6aff460b9f571b9165e9f2f567.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_68ac786d78bb227f71aaa7458181c9f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_68ac786d78bb227f71aaa7458181c9f3.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_eb4140da530b108671d944dd90d2f3d8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_eb4140da530b108671d944dd90d2f3d8.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_d6734aa77727ce9e235fc3f131cf5fd3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_d6734aa77727ce9e235fc3f131cf5fd3.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_f196c046fd6928b3c39852025297a0c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_f196c046fd6928b3c39852025297a0c0.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_13363dc6871a108740e9322842da77bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_13363dc6871a108740e9322842da77bb.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_5f7ff75aee52038d1e165589b4b5ed2c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_5f7ff75aee52038d1e165589b4b5ed2c.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d76b2624cf7790e98f540dcb51035204.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d76b2624cf7790e98f540dcb51035204.jpg not downloaded yet
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_32c6a701ea7f403cca98e600db99b6e1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_32c6a701ea7f403cca98e600db99b6e1.jpg not downloaded yet
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b4950>
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_1fc8fdae261e391af775f39cee9faf6c.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_1fc8fdae261e391af775f39cee9faf6c.jpg saved to cache
2025-12-05 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3624ed0>
2025-12-05 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_23057fcff810a1f4f704eb268a327a85.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_23057fcff810a1f4f704eb268a327a85.jpg saved to cache
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3624550>
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_807f71d29159354e58675e67bd4475de.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_807f71d29159354e58675e67bd4475de.jpg saved to cache
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_b296ac9ee3d910d7110abd169f08b861.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_f7405ee4e99a27316e0ba41a439b8565.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_e1a3476311d86a94c99aa84e53c86c56.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_e1a3476311d86a94c99aa84e53c86c56.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_4a844700a3847af67c816ea721c08a5c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_4a844700a3847af67c816ea721c08a5c.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_3738b8af3ad8056a59f9cddc9d09ec40.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_3738b8af3ad8056a59f9cddc9d09ec40.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_6798590cf76c3ebbfe8a5d243dacddb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_6798590cf76c3ebbfe8a5d243dacddb2.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_9d55e284f7ea910f72e20ae65c899d9f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9d55e284f7ea910f72e20ae65c899d9f.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_f9c07d443ef35c4ad452e8ab3fce43cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_f9c07d443ef35c4ad452e8ab3fce43cd.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_c4cc3b2f91d3a9e581137ff995e1556f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_c4cc3b2f91d3a9e581137ff995e1556f.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d0f353fb2f037d5c56ac7af2147a0dc3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d0f353fb2f037d5c56ac7af2147a0dc3.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_ab666c31d014341403033d9fc0a56529.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ab666c31d014341403033d9fc0a56529.jpg not downloaded yet
2025-12-05 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0f6998a62c6b1bdf8ebdc014f87a386c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_ae024767e434a4112907022bdb666b1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ae024767e434a4112907022bdb666b1d.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_49992028951a6674e04143e7dcfd0db5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_49992028951a6674e04143e7dcfd0db5.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_bf3bdca3ba37369623ee52e43e89691e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_bf3bdca3ba37369623ee52e43e89691e.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_e1f84d1cf959d44c08cb3c30d459f1ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_e1f84d1cf959d44c08cb3c30d459f1ea.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_589b80ec65b8d29c822831ec57bff34a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_589b80ec65b8d29c822831ec57bff34a.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_a2b53bd7e26c52a3e83d2bbc03aa4ab9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a2b53bd7e26c52a3e83d2bbc03aa4ab9.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_30f470736066c78e82d92a5192b63884.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_30f470736066c78e82d92a5192b63884.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_da1ab5e4b2ee966a0c848cc3bbc62a81.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_da1ab5e4b2ee966a0c848cc3bbc62a81.jpg not downloaded yet
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_b34038080cf3299be6e2481a5ede6b7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b34038080cf3299be6e2481a5ede6b7e.jpg not downloaded yet
2025-12-05 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK17945> (referer: https://www.auto1.com/v1/car-details-view/YK17945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0076650>
2025-12-05 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_9789988db815afe0893aac252bdaaa80.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_9789988db815afe0893aac252bdaaa80.jpg saved to cache
2025-12-05 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36b9450>
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_ea424d09942a319784a5af1f37af28b6.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ea424d09942a319784a5af1f37af28b6.jpg saved to cache
2025-12-05 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05d8550>
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_a6081891cf5379941f08503d280572ef.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_a6081891cf5379941f08503d280572ef.jpg saved to cache
2025-12-05 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae005ba10>
2025-12-05 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_f01d70d337f4b616161f0f6eb86eb8a7.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_f01d70d337f4b616161f0f6eb86eb8a7.jpg saved to cache
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8f9faf5698b69680e91d37df78b8e0b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_613df7a96d668a6b8932d60a181119c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_613df7a96d668a6b8932d60a181119c0.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_7c330a008a2aa851884f09eb335c7f8e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_7c330a008a2aa851884f09eb335c7f8e.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_cea0ee89bdf1b78869bdf36bacaa2647.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_cea0ee89bdf1b78869bdf36bacaa2647.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_ac4533acf4cd6a5f8571c58d8544e170.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_ac4533acf4cd6a5f8571c58d8544e170.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_4014230051a2f2000dc8d9486ea6adeb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_4014230051a2f2000dc8d9486ea6adeb.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_347899bc471f396ab3c9d704c153f41d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_347899bc471f396ab3c9d704c153f41d.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_2c658befd82027e9d55aec682d09e912.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_2c658befd82027e9d55aec682d09e912.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_670c9d62c07e3a10d23ecf83b2ec1e60.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_670c9d62c07e3a10d23ecf83b2ec1e60.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_c5c0d5e0492392ca4ddc1908d9a62e12.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_c5c0d5e0492392ca4ddc1908d9a62e12.jpg not downloaded yet
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f3a10>
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_b296ac9ee3d910d7110abd169f08b861.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_b296ac9ee3d910d7110abd169f08b861.jpg saved to cache
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0170ed0>
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_f7405ee4e99a27316e0ba41a439b8565.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_f7405ee4e99a27316e0ba41a439b8565.jpg saved to cache
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_656b15109a5c2307bab97711ebb6c39a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_6d29e2343330c12c96e982ed027fc4da.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_a17056d4d0a7fa6bb16a56848d68becd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_a17056d4d0a7fa6bb16a56848d68becd.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_3d0de4c95df82000acaf64efdc035c5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_3d0de4c95df82000acaf64efdc035c5f.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_0c46a4491bf788b0e8146bc435a7394d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0c46a4491bf788b0e8146bc435a7394d.jpg not downloaded yet
2025-12-05 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_09d0ec6ce8e968c54d9411a15a0be36a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_09d0ec6ce8e968c54d9411a15a0be36a.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_844e0679f57bfc4f580fa46974a35e04.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_844e0679f57bfc4f580fa46974a35e04.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_a200918e53e198718d41577accb434a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a200918e53e198718d41577accb434a0.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_67d955015e9a72e812105f8560883e9f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_67d955015e9a72e812105f8560883e9f.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_26bf9ab129066781e2b2f4992af005d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_26bf9ab129066781e2b2f4992af005d5.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_0eeb82a48485d3f9b6a158545fb6d60d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_0eeb82a48485d3f9b6a158545fb6d60d.jpg not downloaded yet
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f0510>
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_0f6998a62c6b1bdf8ebdc014f87a386c.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0f6998a62c6b1bdf8ebdc014f87a386c.jpg saved to cache
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82ae820f-267e-5834-b71c-8045871fef94 with identifier: YK17945
2025-12-05 20:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82ae820f-267e-5834-b71c-8045871fef94 with scrape type 1
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_50c0775f42d94a13bbba4e01624a3ae0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_50c0775f42d94a13bbba4e01624a3ae0.jpg not downloaded yet
2025-12-05 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8d7c71ada34e3c2ff38ebd7cc1c35447.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f5a90>
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_8f9faf5698b69680e91d37df78b8e0b6.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8f9faf5698b69680e91d37df78b8e0b6.jpg saved to cache
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_bd1feb9cbef2b40d851667d2ab2df1f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_bd1feb9cbef2b40d851667d2ab2df1f8.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_233c7391784a5f01d32c0dfca19c1b5a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_233c7391784a5f01d32c0dfca19c1b5a.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_fd6c0ac12645e7c53188e33c3ce36fea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_fd6c0ac12645e7c53188e33c3ce36fea.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_82efa00b090d0afac554f82b3d9294d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_82efa00b090d0afac554f82b3d9294d3.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_5440a029394ed4917f4467bb435cf635.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_5440a029394ed4917f4467bb435cf635.jpg not downloaded yet
2025-12-05 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_7f8a2129876e382f239fb83e89e57e5f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7f8a2129876e382f239fb83e89e57e5f.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_cd67b1ad53b34f305e04428af462e242.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_cd67b1ad53b34f305e04428af462e242.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_ad558d8edcda8d6f9cbd63ae9e445c13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ad558d8edcda8d6f9cbd63ae9e445c13.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_65c8bbee425006b341c900ef6f722955.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_65c8bbee425006b341c900ef6f722955.jpg not downloaded yet
2025-12-05 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b889f0f2c596f1b47a337fee399396a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_11c92b288bdf090e72c79b66a68a4d0f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f0250>
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_656b15109a5c2307bab97711ebb6c39a.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_656b15109a5c2307bab97711ebb6c39a.jpg saved to cache
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01bafd0>
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_6d29e2343330c12c96e982ed027fc4da.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_6d29e2343330c12c96e982ed027fc4da.jpg saved to cache
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_f29fe9d9d5f6b5bf2ead9afce108925e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_8bb6e731a2029e3f4ecf57bac9facd54.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_8bb6e731a2029e3f4ecf57bac9facd54.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_96680d01ea7da081b20f402e97c1b56c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_96680d01ea7da081b20f402e97c1b56c.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_10c038e90dd58612ec4bd633b413d68b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_10c038e90dd58612ec4bd633b413d68b.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_f16957d9f13ddcaa6c14b2907e560dbc.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_f16957d9f13ddcaa6c14b2907e560dbc.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d9c0b82211b7098dddfa992b2515b0fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d9c0b82211b7098dddfa992b2515b0fe.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_db7f79c636d62f980503ebee399e6cb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_db7f79c636d62f980503ebee399e6cb3.jpg not downloaded yet
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_9b443c1c536ccdf967fe2d7495de8a81.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_9b443c1c536ccdf967fe2d7495de8a81.jpg not downloaded yet
2025-12-05 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_5bf7c44e54cc629e270619f1bffd8e57.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05a4250>
2025-12-05 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_8d7c71ada34e3c2ff38ebd7cc1c35447.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8d7c71ada34e3c2ff38ebd7cc1c35447.jpg saved to cache
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_dddb8457ae84f20bd82f3abac73785f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_dddb8457ae84f20bd82f3abac73785f1.jpg not downloaded yet
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_a951a396ae015953b7536239ee7031eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_a951a396ae015953b7536239ee7031eb.jpg not downloaded yet
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_d4ac1c861ae08c5f906abeb1b048a4be.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_d4ac1c861ae08c5f906abeb1b048a4be.jpg not downloaded yet
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_b4266c5eb6e9fac08a3066f2c34d2348.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_b4266c5eb6e9fac08a3066f2c34d2348.jpg not downloaded yet
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d03316b2e1ed1714fac7b9f363b854eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d03316b2e1ed1714fac7b9f363b854eb.jpg not downloaded yet
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_e909d3e197bf95b80a767ed2ee1a8c01.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_e909d3e197bf95b80a767ed2ee1a8c01.jpg not downloaded yet
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_324292d529505cce5d3064474f1cef74.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_324292d529505cce5d3064474f1cef74.jpg not downloaded yet
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00582d0>
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_b889f0f2c596f1b47a337fee399396a4.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b889f0f2c596f1b47a337fee399396a4.jpg saved to cache
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f3810>
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_11c92b288bdf090e72c79b66a68a4d0f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_11c92b288bdf090e72c79b66a68a4d0f.jpg saved to cache
2025-12-05 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_f6aa9bfbc0ac40798a368c85964a1969.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_00c8ea07f4c1bf1f62b6e99337badb06.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_32c6a701ea7f403cca98e600db99b6e1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ab666c31d014341403033d9fc0a56529.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d76b2624cf7790e98f540dcb51035204.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0448650>
2025-12-05 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa1%252F3aa1fe0fdb0507442f937a66b8a7b1f8%252Fpa%252FVY71575_f29fe9d9d5f6b5bf2ead9afce108925e.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_f29fe9d9d5f6b5bf2ead9afce108925e.jpg saved to cache
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce7210a2-8a70-5aff-a513-66255087e846
2025-12-05 20:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce7210a2-8a70-5aff-a513-66255087e846, skipping ID generation
2025-12-05 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7210a2-8a70-5aff-a513-66255087e846 with scrape type 1
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ce7210a2-8a70-5aff-a513-66255087e846 from tracking dictionaries
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce7210a2-8a70-5aff-a513-66255087e846 sending to next pipeline
2025-12-05 20:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce7210a2-8a70-5aff-a513-66255087e846, identifier: VY71575
2025-12-05 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b34038080cf3299be6e2481a5ede6b7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_2b0d9affccf7374ea11aaba2ea432ca1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_2b0d9affccf7374ea11aaba2ea432ca1.jpg not downloaded yet
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_7fd023fdb3e95d7710993969b4450862.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_7fd023fdb3e95d7710993969b4450862.jpg not downloaded yet
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_01feedccd81df295455b037721841131.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_01feedccd81df295455b037721841131.jpg not downloaded yet
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d92a320588ce71d0814d6fd4cef06711.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92a320588ce71d0814d6fd4cef06711.jpg not downloaded yet
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_14ed139ac189877ddd94af1014297fa6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_14ed139ac189877ddd94af1014297fa6.jpg not downloaded yet
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_e378149e831c9793655bf3737343a76f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_e378149e831c9793655bf3737343a76f.jpg not downloaded yet
2025-12-05 20:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce7210a2-8a70-5aff-a513-66255087e846 with identifier: VY71575
2025-12-05 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce7210a2-8a70-5aff-a513-66255087e846 with identifier: VY71575
2025-12-05 20:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce7210a2-8a70-5aff-a513-66255087e846 with identifier: VY71575 to the API
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_f29fe9d9d5f6b5bf2ead9afce108925e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:23:53Z',
 'fuel_type': 'gas',
 'id': 'ce7210a2-8a70-5aff-a513-66255087e846',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY71575',
 'listing': 'auction',
 'location': 'IT, Frosinone',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 51098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2990763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_f29fe9d9d5f6b5bf2ead9afce108925e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_50c2ff24bd5e013d1be71a99820f834a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_6c62f5f0d2edd2c1b4e9a5f891042a52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_9b262dbe24a0203b8fa4e5b9b42751b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47b6f8d5d4f7447ad703b6ecc2215454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_056548d84bf5d2999a41ab12349288d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_0ccfc342522d0a8779aa57ef90a0daab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2375981,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_62b521f77d82ab8d92e56c340db7628a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_5eabbdd7df897b49ae6971302ff62e66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_47f90d19c62faf97b4f8fdae11ce87bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_4a8cd38dc0338af13ac7dae8a3514fcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_882ddd1a412d27ad203ed3a5a8d05af0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_c81f9f517a8554434791cd66a1a9cbee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_93f8921260b4dfb7601b67cb13c1f43f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce7210a2-8a70-5aff-a513-66255087e846/ce7210a2-8a70-5aff-a513-66255087e846_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a1/3aa1fe0fdb0507442f937a66b8a7b1f8/pa/VY71575_59164ac09c1a4b8bf913e3c1e6bff9ba.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Extreme',
 'transmission': 'manual',
 'trim': 'Extreme',
 'year': 2023}
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY71575%27 HTTP/1.1" 200 None
2025-12-05 20:07:18 [auto1.it] INFO: Saving data for VY71575: {'created_time': 1764965238.090437, 'last_price_update_time': 1764965238.090448, 'auction_closing_time': 1765038233.0}
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY71575') HTTP/1.1" 204 0
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0266fd0>
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_5bf7c44e54cc629e270619f1bffd8e57.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_5bf7c44e54cc629e270619f1bffd8e57.jpg saved to cache
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_2421a5bd779f9c8918a16beada737e92.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_50c0775f42d94a13bbba4e01624a3ae0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_c5c0d5e0492392ca4ddc1908d9a62e12.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_9cd7b14f80a382a73ca4886bfec159ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9cd7b14f80a382a73ca4886bfec159ad.jpg not downloaded yet
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_55a755de55ad7c9964dc58a19b189247.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_55a755de55ad7c9964dc58a19b189247.jpg not downloaded yet
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_3fd16a8a51e1a4768e492b687fd519b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_3fd16a8a51e1a4768e492b687fd519b3.jpg not downloaded yet
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d30360fda5c0a51c126e7e5dd9e8b1be.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d30360fda5c0a51c126e7e5dd9e8b1be.jpg not downloaded yet
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_97f35a66124b9294e9edb75953536648.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_97f35a66124b9294e9edb75953536648.jpg not downloaded yet
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_b73cbf5826fde14ccc6954ea9405b47f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_b73cbf5826fde14ccc6954ea9405b47f.jpg not downloaded yet
2025-12-05 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_da1ab5e4b2ee966a0c848cc3bbc62a81.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a2b53bd7e26c52a3e83d2bbc03aa4ab9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae005a950>
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_f6aa9bfbc0ac40798a368c85964a1969.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_f6aa9bfbc0ac40798a368c85964a1969.jpg saved to cache
2025-12-05 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae008d650>
2025-12-05 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_00c8ea07f4c1bf1f62b6e99337badb06.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_00c8ea07f4c1bf1f62b6e99337badb06.jpg saved to cache
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a8890>
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_32c6a701ea7f403cca98e600db99b6e1.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_32c6a701ea7f403cca98e600db99b6e1.jpg saved to cache
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d5c50>
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_ab666c31d014341403033d9fc0a56529.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ab666c31d014341403033d9fc0a56529.jpg saved to cache
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01cd550>
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d76b2624cf7790e98f540dcb51035204.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d76b2624cf7790e98f540dcb51035204.jpg saved to cache
2025-12-05 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad372a510>
2025-12-05 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_b34038080cf3299be6e2481a5ede6b7e.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b34038080cf3299be6e2481a5ede6b7e.jpg saved to cache
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_0eeb82a48485d3f9b6a158545fb6d60d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_65c8bbee425006b341c900ef6f722955.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_e8fb144c4a08bcc76065b579bf16e6e4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_e8fb144c4a08bcc76065b579bf16e6e4.jpg not downloaded yet
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_6f67377792f899b1e8c77b8d1553e4da.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_6f67377792f899b1e8c77b8d1553e4da.jpg not downloaded yet
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_cdc6fb41ad561d4709576f8630d2e58d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_cdc6fb41ad561d4709576f8630d2e58d.jpg not downloaded yet
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d92bdc052bd81f066585c2648d023992.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92bdc052bd81f066585c2648d023992.jpg not downloaded yet
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_8aeae47e420695c60c2551bb5150cf89.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_8aeae47e420695c60c2551bb5150cf89.jpg not downloaded yet
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_8b064aae16bd44a53fd79aebb51027bb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8b064aae16bd44a53fd79aebb51027bb.jpg not downloaded yet
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f5ad0>
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_2421a5bd779f9c8918a16beada737e92.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_2421a5bd779f9c8918a16beada737e92.jpg saved to cache
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae006f6d0>
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_50c0775f42d94a13bbba4e01624a3ae0.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_50c0775f42d94a13bbba4e01624a3ae0.jpg saved to cache
2025-12-05 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae015f590>
2025-12-05 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_c5c0d5e0492392ca4ddc1908d9a62e12.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_c5c0d5e0492392ca4ddc1908d9a62e12.jpg saved to cache
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_7179f498ffd26a5d0ed1234279bbae54.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_7179f498ffd26a5d0ed1234279bbae54.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_86a38732cff954b91f86e23246dc7f69.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_86a38732cff954b91f86e23246dc7f69.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_4fb6719aca1b7339eb4c71228e5cd41c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_4fb6719aca1b7339eb4c71228e5cd41c.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_7ec92a03a1db17df70a677574d72e174.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_7ec92a03a1db17df70a677574d72e174.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_bf5ba44a41214e8110a06cf67331dfc2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_bf5ba44a41214e8110a06cf67331dfc2.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_bb6c77a2ee17a46f0b2af5f82687dec2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_bb6c77a2ee17a46f0b2af5f82687dec2.jpg not downloaded yet
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e5bd0>
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_da1ab5e4b2ee966a0c848cc3bbc62a81.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_da1ab5e4b2ee966a0c848cc3bbc62a81.jpg saved to cache
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363b250>
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_a2b53bd7e26c52a3e83d2bbc03aa4ab9.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a2b53bd7e26c52a3e83d2bbc03aa4ab9.jpg saved to cache
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_97f35a66124b9294e9edb75953536648.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_b73cbf5826fde14ccc6954ea9405b47f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ad558d8edcda8d6f9cbd63ae9e445c13.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_dae899741a3eb10bd4b6a7338c84f3cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_dae899741a3eb10bd4b6a7338c84f3cf.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_d376a0a26c56d87556d4e1cda795e76d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d376a0a26c56d87556d4e1cda795e76d.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_38ed6c279aeb9a42126896a2851a9643.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_38ed6c279aeb9a42126896a2851a9643.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_87043fc01b5338179a4276f1b817d992.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_87043fc01b5338179a4276f1b817d992.jpg not downloaded yet
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_35f0c6ea443ba3df6f8ba8584a151bc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_35f0c6ea443ba3df6f8ba8584a151bc9.jpg not downloaded yet
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01e5210>
2025-12-05 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_0eeb82a48485d3f9b6a158545fb6d60d.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_0eeb82a48485d3f9b6a158545fb6d60d.jpg saved to cache
2025-12-05 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3707b10>
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_65c8bbee425006b341c900ef6f722955.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_65c8bbee425006b341c900ef6f722955.jpg saved to cache
2025-12-05 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_55a755de55ad7c9964dc58a19b189247.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d30360fda5c0a51c126e7e5dd9e8b1be.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_4c869406f6e1af348054988f88b495d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4c869406f6e1af348054988f88b495d3.jpg not downloaded yet
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36b2d10>
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_97f35a66124b9294e9edb75953536648.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_97f35a66124b9294e9edb75953536648.jpg saved to cache
2025-12-05 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f3710>
2025-12-05 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_b73cbf5826fde14ccc6954ea9405b47f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_b73cbf5826fde14ccc6954ea9405b47f.jpg saved to cache
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3510dd0>
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_ad558d8edcda8d6f9cbd63ae9e445c13.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ad558d8edcda8d6f9cbd63ae9e445c13.jpg saved to cache
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_cdced36013e8cfcfefd4c4065dd401fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_cdced36013e8cfcfefd4c4065dd401fd.jpg not downloaded yet
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9cd7b14f80a382a73ca4886bfec159ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_e378149e831c9793655bf3737343a76f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_14ed139ac189877ddd94af1014297fa6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_01feedccd81df295455b037721841131.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92a320588ce71d0814d6fd4cef06711.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_8c91204db133e2572c6e57384b3d5f6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8c91204db133e2572c6e57384b3d5f6f.jpg not downloaded yet
2025-12-05 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05f65d0>
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_55a755de55ad7c9964dc58a19b189247.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_55a755de55ad7c9964dc58a19b189247.jpg saved to cache
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36176d0>
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d30360fda5c0a51c126e7e5dd9e8b1be.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d30360fda5c0a51c126e7e5dd9e8b1be.jpg saved to cache
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_bf5ba44a41214e8110a06cf67331dfc2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_324292d529505cce5d3064474f1cef74.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_bb6c77a2ee17a46f0b2af5f82687dec2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [scrapy.extensions.logstats] INFO: Crawled 486 pages (at 54 pages/min), scraped 165 items (at 17 items/min)
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_0e4a0154765ea444761e5e27f38e7b01.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_0e4a0154765ea444761e5e27f38e7b01.jpg not downloaded yet
2025-12-05 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_2b0d9affccf7374ea11aaba2ea432ca1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_4cd80eec7cdd7f71a63618cbdcc2f683.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4cd80eec7cdd7f71a63618cbdcc2f683.jpg not downloaded yet
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0531f90>
2025-12-05 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_9cd7b14f80a382a73ca4886bfec159ad.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9cd7b14f80a382a73ca4886bfec159ad.jpg saved to cache
2025-12-05 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f1f50>
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_e378149e831c9793655bf3737343a76f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_e378149e831c9793655bf3737343a76f.jpg saved to cache
2025-12-05 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae008a090>
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_14ed139ac189877ddd94af1014297fa6.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_14ed139ac189877ddd94af1014297fa6.jpg saved to cache
2025-12-05 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00ad310>
2025-12-05 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_01feedccd81df295455b037721841131.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_01feedccd81df295455b037721841131.jpg saved to cache
2025-12-05 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0081150>
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d92a320588ce71d0814d6fd4cef06711.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92a320588ce71d0814d6fd4cef06711.jpg saved to cache
2025-12-05 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_7ec92a03a1db17df70a677574d72e174.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_86a38732cff954b91f86e23246dc7f69.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4c869406f6e1af348054988f88b495d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_4478aeceeb493af1a7953fe8e9a44b40.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4478aeceeb493af1a7953fe8e9a44b40.jpg not downloaded yet
2025-12-05 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_4fb6719aca1b7339eb4c71228e5cd41c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36b5390>
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_bf5ba44a41214e8110a06cf67331dfc2.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_bf5ba44a41214e8110a06cf67331dfc2.jpg saved to cache
2025-12-05 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0329690>
2025-12-05 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_324292d529505cce5d3064474f1cef74.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_324292d529505cce5d3064474f1cef74.jpg saved to cache
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04808d0>
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_bb6c77a2ee17a46f0b2af5f82687dec2.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_bb6c77a2ee17a46f0b2af5f82687dec2.jpg saved to cache
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae24e7a90>
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_2b0d9affccf7374ea11aaba2ea432ca1.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_2b0d9affccf7374ea11aaba2ea432ca1.jpg saved to cache
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_7fd023fdb3e95d7710993969b4450862.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_35f0c6ea443ba3df6f8ba8584a151bc9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_38ed6c279aeb9a42126896a2851a9643.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d376a0a26c56d87556d4e1cda795e76d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_87043fc01b5338179a4276f1b817d992.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7264fd63cb330d2f754bbd9572ac5311.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad35101d0>
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_7ec92a03a1db17df70a677574d72e174.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_7ec92a03a1db17df70a677574d72e174.jpg saved to cache
2025-12-05 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37b1750>
2025-12-05 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_86a38732cff954b91f86e23246dc7f69.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_86a38732cff954b91f86e23246dc7f69.jpg saved to cache
2025-12-05 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04ae590>
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_4c869406f6e1af348054988f88b495d3.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4c869406f6e1af348054988f88b495d3.jpg saved to cache
2025-12-05 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056b1d0>
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_4fb6719aca1b7339eb4c71228e5cd41c.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_4fb6719aca1b7339eb4c71228e5cd41c.jpg saved to cache
2025-12-05 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03a4310>
2025-12-05 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_7fd023fdb3e95d7710993969b4450862.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_7fd023fdb3e95d7710993969b4450862.jpg saved to cache
2025-12-05 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae018b290>
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_35f0c6ea443ba3df6f8ba8584a151bc9.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_35f0c6ea443ba3df6f8ba8584a151bc9.jpg saved to cache
2025-12-05 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04b9d90>
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_38ed6c279aeb9a42126896a2851a9643.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_38ed6c279aeb9a42126896a2851a9643.jpg saved to cache
2025-12-05 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0484650>
2025-12-05 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_d376a0a26c56d87556d4e1cda795e76d.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d376a0a26c56d87556d4e1cda795e76d.jpg saved to cache
2025-12-05 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03746d0>
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_87043fc01b5338179a4276f1b817d992.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_87043fc01b5338179a4276f1b817d992.jpg saved to cache
2025-12-05 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03c9c90>
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_7264fd63cb330d2f754bbd9572ac5311.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7264fd63cb330d2f754bbd9572ac5311.jpg saved to cache
2025-12-05 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_30f470736066c78e82d92a5192b63884.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_cdced36013e8cfcfefd4c4065dd401fd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_dae899741a3eb10bd4b6a7338c84f3cf.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8c91204db133e2572c6e57384b3d5f6f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4cd80eec7cdd7f71a63618cbdcc2f683.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_7179f498ffd26a5d0ed1234279bbae54.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_0e4a0154765ea444761e5e27f38e7b01.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_3fd16a8a51e1a4768e492b687fd519b3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_8aeae47e420695c60c2551bb5150cf89.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92bdc052bd81f066585c2648d023992.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_e8fb144c4a08bcc76065b579bf16e6e4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4478aeceeb493af1a7953fe8e9a44b40.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8b064aae16bd44a53fd79aebb51027bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_e909d3e197bf95b80a767ed2ee1a8c01.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0162950>
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_30f470736066c78e82d92a5192b63884.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_30f470736066c78e82d92a5192b63884.jpg saved to cache
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d03316b2e1ed1714fac7b9f363b854eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_a951a396ae015953b7536239ee7031eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_9b443c1c536ccdf967fe2d7495de8a81.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_6f67377792f899b1e8c77b8d1553e4da.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_cdc6fb41ad561d4709576f8630d2e58d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae2533ed0>
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_cdced36013e8cfcfefd4c4065dd401fd.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_cdced36013e8cfcfefd4c4065dd401fd.jpg saved to cache
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b5910>
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_dae899741a3eb10bd4b6a7338c84f3cf.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_dae899741a3eb10bd4b6a7338c84f3cf.jpg saved to cache
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007e090>
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_8c91204db133e2572c6e57384b3d5f6f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8c91204db133e2572c6e57384b3d5f6f.jpg saved to cache
2025-12-05 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36fb7d0>
2025-12-05 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_4cd80eec7cdd7f71a63618cbdcc2f683.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4cd80eec7cdd7f71a63618cbdcc2f683.jpg saved to cache
2025-12-05 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae007ead0>
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_7179f498ffd26a5d0ed1234279bbae54.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_7179f498ffd26a5d0ed1234279bbae54.jpg saved to cache
2025-12-05 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b6c90>
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_0e4a0154765ea444761e5e27f38e7b01.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_0e4a0154765ea444761e5e27f38e7b01.jpg saved to cache
2025-12-05 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03b6790>
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_3fd16a8a51e1a4768e492b687fd519b3.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_3fd16a8a51e1a4768e492b687fd519b3.jpg saved to cache
2025-12-05 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0375d90>
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_8aeae47e420695c60c2551bb5150cf89.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_8aeae47e420695c60c2551bb5150cf89.jpg saved to cache
2025-12-05 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02fbe50>
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d92bdc052bd81f066585c2648d023992.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92bdc052bd81f066585c2648d023992.jpg saved to cache
2025-12-05 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02f8f90>
2025-12-05 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_e8fb144c4a08bcc76065b579bf16e6e4.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_e8fb144c4a08bcc76065b579bf16e6e4.jpg saved to cache
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04d5810>
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_4478aeceeb493af1a7953fe8e9a44b40.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4478aeceeb493af1a7953fe8e9a44b40.jpg saved to cache
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02e4690>
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_8b064aae16bd44a53fd79aebb51027bb.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8b064aae16bd44a53fd79aebb51027bb.jpg saved to cache
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00e0590>
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_e909d3e197bf95b80a767ed2ee1a8c01.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_e909d3e197bf95b80a767ed2ee1a8c01.jpg saved to cache
2025-12-05 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_d4ac1c861ae08c5f906abeb1b048a4be.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04fbdd0>
2025-12-05 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d03316b2e1ed1714fac7b9f363b854eb.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d03316b2e1ed1714fac7b9f363b854eb.jpg saved to cache
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0486490>
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_a951a396ae015953b7536239ee7031eb.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_a951a396ae015953b7536239ee7031eb.jpg saved to cache
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3612a10>
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004d94d37fa9bbc973e9e9417bbcacc%252Fpa%252FYK17945_9b443c1c536ccdf967fe2d7495de8a81.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_9b443c1c536ccdf967fe2d7495de8a81.jpg saved to cache
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82ae820f-267e-5834-b71c-8045871fef94
2025-12-05 20:07:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82ae820f-267e-5834-b71c-8045871fef94, skipping ID generation
2025-12-05 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82ae820f-267e-5834-b71c-8045871fef94 with scrape type 1
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 82ae820f-267e-5834-b71c-8045871fef94 from tracking dictionaries
2025-12-05 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82ae820f-267e-5834-b71c-8045871fef94 sending to next pipeline
2025-12-05 20:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82ae820f-267e-5834-b71c-8045871fef94, identifier: YK17945
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0570d90>
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_6f67377792f899b1e8c77b8d1553e4da.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_6f67377792f899b1e8c77b8d1553e4da.jpg saved to cache
2025-12-05 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0566290>
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_cdc6fb41ad561d4709576f8630d2e58d.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_cdc6fb41ad561d4709576f8630d2e58d.jpg saved to cache
2025-12-05 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_dddb8457ae84f20bd82f3abac73785f1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82ae820f-267e-5834-b71c-8045871fef94 with identifier: YK17945
2025-12-05 20:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82ae820f-267e-5834-b71c-8045871fef94 with identifier: YK17945
2025-12-05 20:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82ae820f-267e-5834-b71c-8045871fef94 with identifier: YK17945 to the API
2025-12-05 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_9b443c1c536ccdf967fe2d7495de8a81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:19:51Z',
 'fuel_type': 'diesel',
 'id': '82ae820f-267e-5834-b71c-8045871fef94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK17945',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 146543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_50c0775f42d94a13bbba4e01624a3ae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_65c8bbee425006b341c900ef6f722955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_9b443c1c536ccdf967fe2d7495de8a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_324292d529505cce5d3064474f1cef74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_e378149e831c9793655bf3737343a76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_b73cbf5826fde14ccc6954ea9405b47f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8b064aae16bd44a53fd79aebb51027bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_bb6c77a2ee17a46f0b2af5f82687dec2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_35f0c6ea443ba3df6f8ba8584a151bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4c869406f6e1af348054988f88b495d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_cdced36013e8cfcfefd4c4065dd401fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_8c91204db133e2572c6e57384b3d5f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_0e4a0154765ea444761e5e27f38e7b01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4cd80eec7cdd7f71a63618cbdcc2f683.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ae820f-267e-5834-b71c-8045871fef94/82ae820f-267e-5834-b71c-8045871fef94_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004d94d37fa9bbc973e9e9417bbcacc/pa/YK17945_4478aeceeb493af1a7953fe8e9a44b40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK17945%27 HTTP/1.1" 200 None
2025-12-05 20:07:36 [auto1.it] INFO: Saving data for YK17945: {'created_time': 1764965256.125808, 'last_price_update_time': 1764965256.12582, 'auction_closing_time': 1765037991.0}
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YK17945') HTTP/1.1" 204 0
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_db7f79c636d62f980503ebee399e6cb3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d9c0b82211b7098dddfa992b2515b0fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_96680d01ea7da081b20f402e97c1b56c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_10c038e90dd58612ec4bd633b413d68b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_8bb6e731a2029e3f4ecf57bac9facd54.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05677d0>
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_d4ac1c861ae08c5f906abeb1b048a4be.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_d4ac1c861ae08c5f906abeb1b048a4be.jpg saved to cache
2025-12-05 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:36 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3671810>
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_dddb8457ae84f20bd82f3abac73785f1.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_dddb8457ae84f20bd82f3abac73785f1.jpg saved to cache
2025-12-05 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_cd67b1ad53b34f305e04428af462e242.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_fd6c0ac12645e7c53188e33c3ce36fea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_82efa00b090d0afac554f82b3d9294d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_233c7391784a5f01d32c0dfca19c1b5a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0194c90>
2025-12-05 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F08%252F04082ea18a3ef18df54a6f32fdafd284%252Fpa%252FJB86723_db7f79c636d62f980503ebee399e6cb3.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_db7f79c636d62f980503ebee399e6cb3.jpg saved to cache
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0
2025-12-05 20:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ca0c369-123f-5db5-b94c-e77751c5fcb0, skipping ID generation
2025-12-05 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0 with scrape type 1
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ca0c369-123f-5db5-b94c-e77751c5fcb0 from tracking dictionaries
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ca0c369-123f-5db5-b94c-e77751c5fcb0 sending to next pipeline
2025-12-05 20:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ca0c369-123f-5db5-b94c-e77751c5fcb0, identifier: JB86723
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03ac6d0>
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d9c0b82211b7098dddfa992b2515b0fe.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d9c0b82211b7098dddfa992b2515b0fe.jpg saved to cache
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad368c190>
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_96680d01ea7da081b20f402e97c1b56c.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_96680d01ea7da081b20f402e97c1b56c.jpg saved to cache
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae010cad0>
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_10c038e90dd58612ec4bd633b413d68b.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_10c038e90dd58612ec4bd633b413d68b.jpg saved to cache
2025-12-05 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e2d10>
2025-12-05 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_8bb6e731a2029e3f4ecf57bac9facd54.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_8bb6e731a2029e3f4ecf57bac9facd54.jpg saved to cache
2025-12-05 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ca0c369-123f-5db5-b94c-e77751c5fcb0 with identifier: JB86723
2025-12-05 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ca0c369-123f-5db5-b94c-e77751c5fcb0 with identifier: JB86723
2025-12-05 20:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ca0c369-123f-5db5-b94c-e77751c5fcb0 with identifier: JB86723 to the API
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_db7f79c636d62f980503ebee399e6cb3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-06T16:23:40Z',
 'fuel_type': 'diesel',
 'id': '8ca0c369-123f-5db5-b94c-e77751c5fcb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB86723',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 100354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b889f0f2c596f1b47a337fee399396a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_5bf7c44e54cc629e270619f1bffd8e57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_32c6a701ea7f403cca98e600db99b6e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ab666c31d014341403033d9fc0a56529.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_b34038080cf3299be6e2481a5ede6b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_c5c0d5e0492392ca4ddc1908d9a62e12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_0eeb82a48485d3f9b6a158545fb6d60d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_ad558d8edcda8d6f9cbd63ae9e445c13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_db7f79c636d62f980503ebee399e6cb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_e909d3e197bf95b80a767ed2ee1a8c01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_14ed139ac189877ddd94af1014297fa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_97f35a66124b9294e9edb75953536648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_8aeae47e420695c60c2551bb5150cf89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_bf5ba44a41214e8110a06cf67331dfc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca0c369-123f-5db5-b94c-e77751c5fcb0/8ca0c369-123f-5db5-b94c-e77751c5fcb0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/08/04082ea18a3ef18df54a6f32fdafd284/pa/JB86723_87043fc01b5338179a4276f1b817d992.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2018}
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB86723%27 HTTP/1.1" 200 None
2025-12-05 20:07:38 [auto1.it] INFO: Saving data for JB86723: {'created_time': 1764965258.666827, 'last_price_update_time': 1764965258.666836, 'auction_closing_time': 1765038220.0}
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB86723') HTTP/1.1" 204 0
2025-12-05 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_67d955015e9a72e812105f8560883e9f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0511910>
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_cd67b1ad53b34f305e04428af462e242.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_cd67b1ad53b34f305e04428af462e242.jpg saved to cache
2025-12-05 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04f7c90>
2025-12-05 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_fd6c0ac12645e7c53188e33c3ce36fea.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_fd6c0ac12645e7c53188e33c3ce36fea.jpg saved to cache
2025-12-05 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04f5f10>
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_82efa00b090d0afac554f82b3d9294d3.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_82efa00b090d0afac554f82b3d9294d3.jpg saved to cache
2025-12-05 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_bd1feb9cbef2b40d851667d2ab2df1f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_26bf9ab129066781e2b2f4992af005d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f5710>
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_233c7391784a5f01d32c0dfca19c1b5a.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_233c7391784a5f01d32c0dfca19c1b5a.jpg saved to cache
2025-12-05 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_844e0679f57bfc4f580fa46974a35e04.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_5440a029394ed4917f4467bb435cf635.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04f6a90>
2025-12-05 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_67d955015e9a72e812105f8560883e9f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_67d955015e9a72e812105f8560883e9f.jpg saved to cache
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e0d10>
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_bd1feb9cbef2b40d851667d2ab2df1f8.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_bd1feb9cbef2b40d851667d2ab2df1f8.jpg saved to cache
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01943d0>
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_26bf9ab129066781e2b2f4992af005d5.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_26bf9ab129066781e2b2f4992af005d5.jpg saved to cache
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0c46a4491bf788b0e8146bc435a7394d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae2340590>
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_844e0679f57bfc4f580fa46974a35e04.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_844e0679f57bfc4f580fa46974a35e04.jpg saved to cache
2025-12-05 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b5a50>
2025-12-05 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_5440a029394ed4917f4467bb435cf635.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_5440a029394ed4917f4467bb435cf635.jpg saved to cache
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_3d0de4c95df82000acaf64efdc035c5f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_670c9d62c07e3a10d23ecf83b2ec1e60.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03f42d0>
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_0c46a4491bf788b0e8146bc435a7394d.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0c46a4491bf788b0e8146bc435a7394d.jpg saved to cache
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_09d0ec6ce8e968c54d9411a15a0be36a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_a17056d4d0a7fa6bb16a56848d68becd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a200918e53e198718d41577accb434a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_2c658befd82027e9d55aec682d09e912.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f4490>
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_3d0de4c95df82000acaf64efdc035c5f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_3d0de4c95df82000acaf64efdc035c5f.jpg saved to cache
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae053e310>
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_670c9d62c07e3a10d23ecf83b2ec1e60.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_670c9d62c07e3a10d23ecf83b2ec1e60.jpg saved to cache
2025-12-05 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_b4266c5eb6e9fac08a3066f2c34d2348.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_cea0ee89bdf1b78869bdf36bacaa2647.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_4014230051a2f2000dc8d9486ea6adeb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_347899bc471f396ab3c9d704c153f41d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_f16957d9f13ddcaa6c14b2907e560dbc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0264410>
2025-12-05 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_09d0ec6ce8e968c54d9411a15a0be36a.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_09d0ec6ce8e968c54d9411a15a0be36a.jpg saved to cache
2025-12-05 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad364ed10>
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_a17056d4d0a7fa6bb16a56848d68becd.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_a17056d4d0a7fa6bb16a56848d68becd.jpg saved to cache
2025-12-05 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05b7010>
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_a200918e53e198718d41577accb434a0.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a200918e53e198718d41577accb434a0.jpg saved to cache
2025-12-05 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3627c90>
2025-12-05 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_2c658befd82027e9d55aec682d09e912.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_2c658befd82027e9d55aec682d09e912.jpg saved to cache
2025-12-05 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_ac4533acf4cd6a5f8571c58d8544e170.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_7c330a008a2aa851884f09eb335c7f8e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_bf3bdca3ba37369623ee52e43e89691e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_613df7a96d668a6b8932d60a181119c0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_589b80ec65b8d29c822831ec57bff34a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7f8a2129876e382f239fb83e89e57e5f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014ea10>
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_b4266c5eb6e9fac08a3066f2c34d2348.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_b4266c5eb6e9fac08a3066f2c34d2348.jpg saved to cache
2025-12-05 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0436210>
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_cea0ee89bdf1b78869bdf36bacaa2647.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_cea0ee89bdf1b78869bdf36bacaa2647.jpg saved to cache
2025-12-05 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014c150>
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_4014230051a2f2000dc8d9486ea6adeb.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_4014230051a2f2000dc8d9486ea6adeb.jpg saved to cache
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0578610>
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_347899bc471f396ab3c9d704c153f41d.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_347899bc471f396ab3c9d704c153f41d.jpg saved to cache
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36a0810>
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_f16957d9f13ddcaa6c14b2907e560dbc.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_f16957d9f13ddcaa6c14b2907e560dbc.jpg saved to cache
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_e1f84d1cf959d44c08cb3c30d459f1ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_49992028951a6674e04143e7dcfd0db5.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ae024767e434a4112907022bdb666b1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_c4cc3b2f91d3a9e581137ff995e1556f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d0f353fb2f037d5c56ac7af2147a0dc3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36504d0>
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_ac4533acf4cd6a5f8571c58d8544e170.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_ac4533acf4cd6a5f8571c58d8544e170.jpg saved to cache
2025-12-05 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f5110>
2025-12-05 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_7c330a008a2aa851884f09eb335c7f8e.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_7c330a008a2aa851884f09eb335c7f8e.jpg saved to cache
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d4a10>
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_bf3bdca3ba37369623ee52e43e89691e.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_bf3bdca3ba37369623ee52e43e89691e.jpg saved to cache
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad350cb10>
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_613df7a96d668a6b8932d60a181119c0.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_613df7a96d668a6b8932d60a181119c0.jpg saved to cache
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae015f150>
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_589b80ec65b8d29c822831ec57bff34a.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_589b80ec65b8d29c822831ec57bff34a.jpg saved to cache
2025-12-05 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00a2110>
2025-12-05 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_7f8a2129876e382f239fb83e89e57e5f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7f8a2129876e382f239fb83e89e57e5f.jpg saved to cache
2025-12-05 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9d55e284f7ea910f72e20ae65c899d9f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_3738b8af3ad8056a59f9cddc9d09ec40.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_5f7ff75aee52038d1e165589b4b5ed2c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_13363dc6871a108740e9322842da77bb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c5610>
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_e1f84d1cf959d44c08cb3c30d459f1ea.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_e1f84d1cf959d44c08cb3c30d459f1ea.jpg saved to cache
2025-12-05 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b4c10>
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_49992028951a6674e04143e7dcfd0db5.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_49992028951a6674e04143e7dcfd0db5.jpg saved to cache
2025-12-05 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03cdbd0>
2025-12-05 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_ae024767e434a4112907022bdb666b1d.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ae024767e434a4112907022bdb666b1d.jpg saved to cache
2025-12-05 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3604a90>
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_c4cc3b2f91d3a9e581137ff995e1556f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_c4cc3b2f91d3a9e581137ff995e1556f.jpg saved to cache
2025-12-05 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0171810>
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d0f353fb2f037d5c56ac7af2147a0dc3.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d0f353fb2f037d5c56ac7af2147a0dc3.jpg saved to cache
2025-12-05 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_6798590cf76c3ebbfe8a5d243dacddb2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_e1a3476311d86a94c99aa84e53c86c56.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_eb4140da530b108671d944dd90d2f3d8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_f196c046fd6928b3c39852025297a0c0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03cb950>
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_9d55e284f7ea910f72e20ae65c899d9f.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9d55e284f7ea910f72e20ae65c899d9f.jpg saved to cache
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad368cf90>
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_3738b8af3ad8056a59f9cddc9d09ec40.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_3738b8af3ad8056a59f9cddc9d09ec40.jpg saved to cache
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36a12d0>
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_5f7ff75aee52038d1e165589b4b5ed2c.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_5f7ff75aee52038d1e165589b4b5ed2c.jpg saved to cache
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01259d0>
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_13363dc6871a108740e9322842da77bb.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_13363dc6871a108740e9322842da77bb.jpg saved to cache
2025-12-05 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_f9c07d443ef35c4ad452e8ab3fce43cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_4a844700a3847af67c816ea721c08a5c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_68ac786d78bb227f71aaa7458181c9f3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d7a47856517d89a23abc30efeaed807c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d5d6a7ebdc27ca582d6fd3871e3c6b93.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36137d0>
2025-12-05 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_6798590cf76c3ebbfe8a5d243dacddb2.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_6798590cf76c3ebbfe8a5d243dacddb2.jpg saved to cache
2025-12-05 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad368c550>
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_e1a3476311d86a94c99aa84e53c86c56.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_e1a3476311d86a94c99aa84e53c86c56.jpg saved to cache
2025-12-05 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3610390>
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_eb4140da530b108671d944dd90d2f3d8.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_eb4140da530b108671d944dd90d2f3d8.jpg saved to cache
2025-12-05 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad360d450>
2025-12-05 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_f196c046fd6928b3c39852025297a0c0.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_f196c046fd6928b3c39852025297a0c0.jpg saved to cache
2025-12-05 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_d6734aa77727ce9e235fc3f131cf5fd3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_9605fc6aff460b9f571b9165e9f2f567.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_d05b326bec075180e7f6171753fd93db.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_181ad2cc7446b53652c447b04f80bd84.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0507910>
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_f9c07d443ef35c4ad452e8ab3fce43cd.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_f9c07d443ef35c4ad452e8ab3fce43cd.jpg saved to cache
2025-12-05 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01866d0>
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_4a844700a3847af67c816ea721c08a5c.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_4a844700a3847af67c816ea721c08a5c.jpg saved to cache
2025-12-05 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03412d0>
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_68ac786d78bb227f71aaa7458181c9f3.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_68ac786d78bb227f71aaa7458181c9f3.jpg saved to cache
2025-12-05 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00f6dd0>
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Ff0%252F35f0ef7778836ce84de3b1124fd03560%252Fpa%252FGG58363_d7a47856517d89a23abc30efeaed807c.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d7a47856517d89a23abc30efeaed807c.jpg saved to cache
2025-12-05 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7b93a5d-8057-5653-9d42-b453f02d6587
2025-12-05 20:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7b93a5d-8057-5653-9d42-b453f02d6587, skipping ID generation
2025-12-05 20:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b93a5d-8057-5653-9d42-b453f02d6587 with scrape type 1
2025-12-05 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b7b93a5d-8057-5653-9d42-b453f02d6587 from tracking dictionaries
2025-12-05 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7b93a5d-8057-5653-9d42-b453f02d6587 sending to next pipeline
2025-12-05 20:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7b93a5d-8057-5653-9d42-b453f02d6587, identifier: GG58363
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02bde90>
2025-12-05 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F80%252Fd2805e053f8994e6561c19eaa20a9311%252Fpa%252FKM04068_d5d6a7ebdc27ca582d6fd3871e3c6b93.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d5d6a7ebdc27ca582d6fd3871e3c6b93.jpg saved to cache
2025-12-05 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item adca4081-70b0-5e41-b802-6cdb91200aee
2025-12-05 20:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adca4081-70b0-5e41-b802-6cdb91200aee, skipping ID generation
2025-12-05 20:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adca4081-70b0-5e41-b802-6cdb91200aee with scrape type 1
2025-12-05 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item adca4081-70b0-5e41-b802-6cdb91200aee from tracking dictionaries
2025-12-05 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adca4081-70b0-5e41-b802-6cdb91200aee sending to next pipeline
2025-12-05 20:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adca4081-70b0-5e41-b802-6cdb91200aee, identifier: KM04068
2025-12-05 20:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7b93a5d-8057-5653-9d42-b453f02d6587 with identifier: GG58363
2025-12-05 20:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7b93a5d-8057-5653-9d42-b453f02d6587 with identifier: GG58363
2025-12-05 20:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164866 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164866
2025-12-05 20:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b7b93a5d-8057-5653-9d42-b453f02d6587 spider: auto1.it
2025-12-05 20:07:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: b7b93a5d-8057-5653-9d42-b453f02d6587 due to rule: high_mileage_for_country.json, error: 164866 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164866
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:40:07Z',
 'fuel_type': 'gas',
 'id': 'b7b93a5d-8057-5653-9d42-b453f02d6587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG58363',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 164866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_11c92b288bdf090e72c79b66a68a4d0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d7a47856517d89a23abc30efeaed807c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d76b2624cf7790e98f540dcb51035204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d0f353fb2f037d5c56ac7af2147a0dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_da1ab5e4b2ee966a0c848cc3bbc62a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_670c9d62c07e3a10d23ecf83b2ec1e60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_26bf9ab129066781e2b2f4992af005d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_cd67b1ad53b34f305e04428af462e242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d9c0b82211b7098dddfa992b2515b0fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d03316b2e1ed1714fac7b9f363b854eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92a320588ce71d0814d6fd4cef06711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d30360fda5c0a51c126e7e5dd9e8b1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_d92bdc052bd81f066585c2648d023992.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_7ec92a03a1db17df70a677574d72e174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b93a5d-8057-5653-9d42-b453f02d6587/b7b93a5d-8057-5653-9d42-b453f02d6587_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/f0/35f0ef7778836ce84de3b1124fd03560/pa/GG58363_38ed6c279aeb9a42126896a2851a9643.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech LPG Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG58363%27 HTTP/1.1" 200 None
2025-12-05 20:07:52 [auto1.it] INFO: Saving data for GG58363: {'created_time': 1764965272.434611, 'last_price_update_time': 1764965272.434622, 'auction_closing_time': 1765039207.0}
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GG58363') HTTP/1.1" 204 0
2025-12-05 20:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adca4081-70b0-5e41-b802-6cdb91200aee with identifier: KM04068
2025-12-05 20:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adca4081-70b0-5e41-b802-6cdb91200aee with identifier: KM04068
2025-12-05 20:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159057
2025-12-05 20:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: adca4081-70b0-5e41-b802-6cdb91200aee spider: auto1.it
2025-12-05 20:07:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: adca4081-70b0-5e41-b802-6cdb91200aee due to rule: high_mileage_for_country.json, error: 159057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159057
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:06:58Z',
 'fuel_type': 'petrol',
 'id': 'adca4081-70b0-5e41-b802-6cdb91200aee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM04068',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 159057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2163207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7264fd63cb330d2f754bbd9572ac5311.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d5d6a7ebdc27ca582d6fd3871e3c6b93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_5f7ff75aee52038d1e165589b4b5ed2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_c4cc3b2f91d3a9e581137ff995e1556f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2138222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_30f470736066c78e82d92a5192b63884.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_2c658befd82027e9d55aec682d09e912.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_67d955015e9a72e812105f8560883e9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2188158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_7f8a2129876e382f239fb83e89e57e5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288389,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_f16957d9f13ddcaa6c14b2907e560dbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2381014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_b4266c5eb6e9fac08a3066f2c34d2348.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_01feedccd81df295455b037721841131.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_3fd16a8a51e1a4768e492b687fd519b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_cdc6fb41ad561d4709576f8630d2e58d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_4fb6719aca1b7339eb4c71228e5cd41c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adca4081-70b0-5e41-b802-6cdb91200aee/adca4081-70b0-5e41-b802-6cdb91200aee_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/80/d2805e053f8994e6561c19eaa20a9311/pa/KM04068_d376a0a26c56d87556d4e1cda795e76d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 Sport FWD',
 'transmission': 'manual',
 'trim': 'Sport FWD',
 'year': 2018}
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM04068%27 HTTP/1.1" 200 None
2025-12-05 20:07:52 [auto1.it] INFO: Saving data for KM04068: {'created_time': 1764965272.711003, 'last_price_update_time': 1764965272.711015, 'auction_closing_time': 1765037218.0}
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM04068') HTTP/1.1" 204 0
2025-12-05 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_263190986fec4edb4cdf83ef9b4333a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_960eb0bbb34c271064265c620edb58b9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_7890be9f92521c31ae11ed18e13eab61.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3639b50>
2025-12-05 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_d6734aa77727ce9e235fc3f131cf5fd3.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_d6734aa77727ce9e235fc3f131cf5fd3.jpg saved to cache
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae043fd90>
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_9605fc6aff460b9f571b9165e9f2f567.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_9605fc6aff460b9f571b9165e9f2f567.jpg saved to cache
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae057b290>
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_d05b326bec075180e7f6171753fd93db.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_d05b326bec075180e7f6171753fd93db.jpg saved to cache
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae048a9d0>
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_181ad2cc7446b53652c447b04f80bd84.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_181ad2cc7446b53652c447b04f80bd84.jpg saved to cache
2025-12-05 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0e626d646dab4ea55a8d4bdb387dce12.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02bd490>
2025-12-05 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_263190986fec4edb4cdf83ef9b4333a0.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_263190986fec4edb4cdf83ef9b4333a0.jpg saved to cache
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04f9b50>
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F55%252Fbe5556459d85ee18b1c2912f3680f5fe%252Fpa%252FGU66425_960eb0bbb34c271064265c620edb58b9.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_960eb0bbb34c271064265c620edb58b9.jpg saved to cache
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c47547bb-18ad-57f6-a563-e57ea491a707
2025-12-05 20:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c47547bb-18ad-57f6-a563-e57ea491a707, skipping ID generation
2025-12-05 20:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47547bb-18ad-57f6-a563-e57ea491a707 with scrape type 1
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c47547bb-18ad-57f6-a563-e57ea491a707 from tracking dictionaries
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c47547bb-18ad-57f6-a563-e57ea491a707 sending to next pipeline
2025-12-05 20:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c47547bb-18ad-57f6-a563-e57ea491a707, identifier: GU66425
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae048a290>
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_7890be9f92521c31ae11ed18e13eab61.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_7890be9f92521c31ae11ed18e13eab61.jpg saved to cache
2025-12-05 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_1bc4ef3b275d9fbc69a663ef2efb78b9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c47547bb-18ad-57f6-a563-e57ea491a707 with identifier: GU66425
2025-12-05 20:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c47547bb-18ad-57f6-a563-e57ea491a707 with identifier: GU66425
2025-12-05 20:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165992 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165992
2025-12-05 20:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c47547bb-18ad-57f6-a563-e57ea491a707 spider: auto1.it
2025-12-05 20:07:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c47547bb-18ad-57f6-a563-e57ea491a707 due to rule: high_mileage_for_country.json, error: 165992 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165992
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:08:57Z',
 'fuel_type': 'diesel',
 'id': 'c47547bb-18ad-57f6-a563-e57ea491a707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU66425',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 165992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_960eb0bbb34c271064265c620edb58b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_d05b326bec075180e7f6171753fd93db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_f196c046fd6928b3c39852025297a0c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9d55e284f7ea910f72e20ae65c899d9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_589b80ec65b8d29c822831ec57bff34a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_4014230051a2f2000dc8d9486ea6adeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_844e0679f57bfc4f580fa46974a35e04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_82efa00b090d0afac554f82b3d9294d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_96680d01ea7da081b20f402e97c1b56c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_a951a396ae015953b7536239ee7031eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_2b0d9affccf7374ea11aaba2ea432ca1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_9cd7b14f80a382a73ca4886bfec159ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_e8fb144c4a08bcc76065b579bf16e6e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_7179f498ffd26a5d0ed1234279bbae54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47547bb-18ad-57f6-a563-e57ea491a707/c47547bb-18ad-57f6-a563-e57ea491a707_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/55/be5556459d85ee18b1c2912f3680f5fe/pa/GU66425_dae899741a3eb10bd4b6a7338c84f3cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Business BMT',
 'transmission': 'automatic',
 'trim': 'Business BMT',
 'year': 2019}
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU66425%27 HTTP/1.1" 200 None
2025-12-05 20:07:55 [auto1.it] INFO: Saving data for GU66425: {'created_time': 1764965275.119249, 'last_price_update_time': 1764965275.11926, 'auction_closing_time': 1765037337.0}
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU66425') HTTP/1.1" 204 0
2025-12-05 20:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_923590fbadb8613dd7c249711a017f0a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_67c6a558fc890f2ec43c121f21e83744.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_186a179e81fedf33aa6f7461b8dd4951.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05b5050>
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_0e626d646dab4ea55a8d4bdb387dce12.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0e626d646dab4ea55a8d4bdb387dce12.jpg saved to cache
2025-12-05 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8cb010d796b2a8eb4ee2bc3558e06d95.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_90ab1b540f5972f8d552d2e8de826959.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0f8fb0f044e8149ea4eb856ccfe091ff.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae009f250>
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_1bc4ef3b275d9fbc69a663ef2efb78b9.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_1bc4ef3b275d9fbc69a663ef2efb78b9.jpg saved to cache
2025-12-05 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_7d00a60af1048fb0a448443238f300b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_4967e25b3caf1805bf2c9486104f2f18.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_1e313b44be6bb3f7abc4c7cc6731e24d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03efbd0>
2025-12-05 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_923590fbadb8613dd7c249711a017f0a.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_923590fbadb8613dd7c249711a017f0a.jpg saved to cache
2025-12-05 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00d5710>
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_67c6a558fc890f2ec43c121f21e83744.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_67c6a558fc890f2ec43c121f21e83744.jpg saved to cache
2025-12-05 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae237f310>
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_186a179e81fedf33aa6f7461b8dd4951.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_186a179e81fedf33aa6f7461b8dd4951.jpg saved to cache
2025-12-05 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_2fc7a2df13d7f52c3a7bfe38d685f8fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_f544238788a599d377d99f82e604c327.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_87f9907a4a4489e84a2c048f3888c7f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2025-12-05 20:07:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 20:07:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 20:07:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01c4250>
2025-12-05 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_8cb010d796b2a8eb4ee2bc3558e06d95.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8cb010d796b2a8eb4ee2bc3558e06d95.jpg saved to cache
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022b990>
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_90ab1b540f5972f8d552d2e8de826959.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_90ab1b540f5972f8d552d2e8de826959.jpg saved to cache
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014f9d0>
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F74%252F837434059dc2af282c6854144726095f%252Fpa%252FBY98220_0f8fb0f044e8149ea4eb856ccfe091ff.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0f8fb0f044e8149ea4eb856ccfe091ff.jpg saved to cache
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56423a48-20c0-5784-b301-2669b752030a
2025-12-05 20:07:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56423a48-20c0-5784-b301-2669b752030a, skipping ID generation
2025-12-05 20:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56423a48-20c0-5784-b301-2669b752030a with scrape type 1
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 56423a48-20c0-5784-b301-2669b752030a from tracking dictionaries
2025-12-05 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56423a48-20c0-5784-b301-2669b752030a sending to next pipeline
2025-12-05 20:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56423a48-20c0-5784-b301-2669b752030a, identifier: BY98220
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae057af10>
2025-12-05 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267b0fc2009908b3662bf55d642a867%252Fpa%252FCZ40954_7d00a60af1048fb0a448443238f300b1.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_7d00a60af1048fb0a448443238f300b1.jpg saved to cache
2025-12-05 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8
2025-12-05 20:07:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55fd231b-2d9d-5fb0-b03d-937fafb498f8, skipping ID generation
2025-12-05 20:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8 with scrape type 1
2025-12-05 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 55fd231b-2d9d-5fb0-b03d-937fafb498f8 from tracking dictionaries
2025-12-05 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55fd231b-2d9d-5fb0-b03d-937fafb498f8 sending to next pipeline
2025-12-05 20:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 55fd231b-2d9d-5fb0-b03d-937fafb498f8, identifier: CZ40954
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014cbd0>
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_4967e25b3caf1805bf2c9486104f2f18.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_4967e25b3caf1805bf2c9486104f2f18.jpg saved to cache
2025-12-05 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae048a990>
2025-12-05 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_1e313b44be6bb3f7abc4c7cc6731e24d.jpg') HTTP/1.1" 204 0
2025-12-05 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_1e313b44be6bb3f7abc4c7cc6731e24d.jpg saved to cache
2025-12-05 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220
2025-12-05 20:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220
2025-12-05 20:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56423a48-20c0-5784-b301-2669b752030a with identifier: BY98220 to the API
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0f8fb0f044e8149ea4eb856ccfe091ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:27:59Z',
 'fuel_type': 'diesel',
 'id': '56423a48-20c0-5784-b301-2669b752030a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY98220',
 'listing': 'auction',
 'location': 'IT, Parma',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 114258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_277f3129b248a60aa8cecc1d2708d043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_68662d7da7c1a816facaa364c6ad52b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_a6081891cf5379941f08503d280572ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_1fc8fdae261e391af775f39cee9faf6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_b296ac9ee3d910d7110abd169f08b861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0f8fb0f044e8149ea4eb856ccfe091ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_6d29e2343330c12c96e982ed027fc4da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_7890be9f92521c31ae11ed18e13eab61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_181ad2cc7446b53652c447b04f80bd84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_eb4140da530b108671d944dd90d2f3d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_3738b8af3ad8056a59f9cddc9d09ec40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_bf3bdca3ba37369623ee52e43e89691e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_cea0ee89bdf1b78869bdf36bacaa2647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_0c46a4491bf788b0e8146bc435a7394d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56423a48-20c0-5784-b301-2669b752030a/56423a48-20c0-5784-b301-2669b752030a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/74/837434059dc2af282c6854144726095f/pa/BY98220_233c7391784a5f01d32c0dfca19c1b5a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2019}
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY98220%27 HTTP/1.1" 200 None
2025-12-05 20:07:59 [auto1.it] INFO: Saving data for BY98220: {'created_time': 1764965279.612073, 'last_price_update_time': 1764965279.612082, 'auction_closing_time': 1765038479.0}
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY98220') HTTP/1.1" 204 0
2025-12-05 20:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 55fd231b-2d9d-5fb0-b03d-937fafb498f8 with identifier: CZ40954
2025-12-05 20:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 55fd231b-2d9d-5fb0-b03d-937fafb498f8 with identifier: CZ40954
2025-12-05 20:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193811 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193811
2025-12-05 20:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 55fd231b-2d9d-5fb0-b03d-937fafb498f8 spider: auto1.it
2025-12-05 20:07:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 55fd231b-2d9d-5fb0-b03d-937fafb498f8 due to rule: high_mileage_for_country.json, error: 193811 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193811
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:36:05Z',
 'fuel_type': 'diesel',
 'id': '55fd231b-2d9d-5fb0-b03d-937fafb498f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ40954',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 193811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362127,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_9789988db815afe0893aac252bdaaa80.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_f01d70d337f4b616161f0f6eb86eb8a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601357,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_00c8ea07f4c1bf1f62b6e99337badb06.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_656b15109a5c2307bab97711ebb6c39a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657459,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_7d00a60af1048fb0a448443238f300b1.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708587,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_1bc4ef3b275d9fbc69a663ef2efb78b9.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608540,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_d6734aa77727ce9e235fc3f131cf5fd3.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301571,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_6798590cf76c3ebbfe8a5d243dacddb2.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267973,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_e1f84d1cf959d44c08cb3c30d459f1ea.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334172,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_ac4533acf4cd6a5f8571c58d8544e170.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537892,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_09d0ec6ce8e968c54d9411a15a0be36a.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_fd6c0ac12645e7c53188e33c3ce36fea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216451,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_8bb6e731a2029e3f4ecf57bac9facd54.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fd231b-2d9d-5fb0-b03d-937fafb498f8/55fd231b-2d9d-5fb0-b03d-937fafb498f8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338197,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267b0fc2009908b3662bf55d642a867/pa/CZ40954_dddb8457ae84f20bd82f3abac73785f1.jpg',
             'Width': 1600}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ40954%27 HTTP/1.1" 200 None
2025-12-05 20:07:59 [auto1.it] INFO: Saving data for CZ40954: {'created_time': 1764965279.874664, 'last_price_update_time': 1764965279.874673, 'auction_closing_time': 1765038965.0}
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ40954') HTTP/1.1" 204 0
2025-12-05 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_de7ed9241f63f40fc14cbedc9e19e2b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_6f268b8c3b3a105f6c8b19f34c322028.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_72fab4e32c7676085a2e1a339e39f97a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1c7588f150e89a0f694d87a2aabd9846.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC12614> (referer: https://www.auto1.com/v1/car-details-view/SC12614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW34893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP00862/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3673c10>
2025-12-05 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_2fc7a2df13d7f52c3a7bfe38d685f8fc.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_2fc7a2df13d7f52c3a7bfe38d685f8fc.jpg saved to cache
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0613790>
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Ffe%252F99fe4b5355d1388e8eab72db45db8f1c%252Fpa%252FVW18274_f544238788a599d377d99f82e604c327.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_f544238788a599d377d99f82e604c327.jpg saved to cache
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894
2025-12-05 20:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894, skipping ID generation
2025-12-05 20:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with scrape type 1
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 from tracking dictionaries
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 sending to next pipeline
2025-12-05 20:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894, identifier: VW18274
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad370fa50>
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe1%252F65e1e208eee58a598e166782bbbdeeb1%252Fpa%252FUB92069_87f9907a4a4489e84a2c048f3888c7f9.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_87f9907a4a4489e84a2c048f3888c7f9.jpg saved to cache
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9
2025-12-05 20:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a50fa50-01b1-5ed1-abe2-da34c00de5c9, skipping ID generation
2025-12-05 20:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 with scrape type 1
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 from tracking dictionaries
2025-12-05 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 sending to next pipeline
2025-12-05 20:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a50fa50-01b1-5ed1-abe2-da34c00de5c9, identifier: UB92069
2025-12-05 20:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274
2025-12-05 20:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274
2025-12-05 20:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25f2bdee-ba41-5b35-a5a0-48b0b0d63894 with identifier: VW18274 to the API
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_f544238788a599d377d99f82e604c327.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 265,
 'expiration_date': '2025-12-06T16:17:01Z',
 'fuel_type': 'hybrid',
 'id': '25f2bdee-ba41-5b35-a5a0-48b0b0d63894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW18274',
 'listing': 'auction',
 'location': 'IT, Casagiove',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 101249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_57dd3eac8105f69c79883f0bbae9136d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_67d4a6a370d6da9b097c3fec1e4ab7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_feaf76345e4785897bb1d4356cd53758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_01c3ad2021cdb68ff47b886a9bc866e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_0fe9282f748125fb1b43aef51d75d455.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_9eb01defc8f58cd0b3bef67c9653df35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8c7771abdfdb19a400e7c06786d90ee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_b372d0dbad6b5ad4b7b1e7719309d198.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c7c64865c4407fe6ac07e3c54a025a07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_d8fc0176adf87be423bfb8177129d121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_c22fb6b328650c67a4f883ebc5f5a9c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_2fc7a2df13d7f52c3a7bfe38d685f8fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_f544238788a599d377d99f82e604c327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_23057fcff810a1f4f704eb268a327a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25f2bdee-ba41-5b35-a5a0-48b0b0d63894/25f2bdee-ba41-5b35-a5a0-48b0b0d63894_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/fe/99fe4b5355d1388e8eab72db45db8f1c/pa/VW18274_8f9faf5698b69680e91d37df78b8e0b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Exellence 4WD',
 'transmission': 'automatic',
 'trim': 'Exellence 4WD',
 'year': 2021}
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW18274%27 HTTP/1.1" 200 None
2025-12-05 20:08:01 [auto1.it] INFO: Saving data for VW18274: {'created_time': 1764965281.496269, 'last_price_update_time': 1764965281.496282, 'auction_closing_time': 1765037821.0}
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VW18274') HTTP/1.1" 204 0
2025-12-05 20:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 with identifier: UB92069
2025-12-05 20:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 with identifier: UB92069
2025-12-05 20:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a50fa50-01b1-5ed1-abe2-da34c00de5c9 with identifier: UB92069 to the API
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_87f9907a4a4489e84a2c048f3888c7f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:33:38Z',
 'fuel_type': 'diesel',
 'id': '4a50fa50-01b1-5ed1-abe2-da34c00de5c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB92069',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 33804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1005385,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_87f9907a4a4489e84a2c048f3888c7f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1005385,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_923590fbadb8613dd7c249711a017f0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94073,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_13363dc6871a108740e9322842da77bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605502,
             'Height': 1466,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_f9c07d443ef35c4ad452e8ab3fce43cd.jpg',
             'Width': 900},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94532,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a2b53bd7e26c52a3e83d2bbc03aa4ab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114439,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_347899bc471f396ab3c9d704c153f41d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1072161,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_a200918e53e198718d41577accb434a0.jpg',
             'Width': 1952},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653988,
             'Height': 943,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_5440a029394ed4917f4467bb435cf635.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83286,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_10c038e90dd58612ec4bd633b413d68b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237101,
             'Height': 966,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_d4ac1c861ae08c5f906abeb1b048a4be.jpg',
             'Width': 1563},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681225,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_7fd023fdb3e95d7710993969b4450862.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68644,
             'Height': 460,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_55a755de55ad7c9964dc58a19b189247.jpg',
             'Width': 1205},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59357,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_6f67377792f899b1e8c77b8d1553e4da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a50fa50-01b1-5ed1-abe2-da34c00de5c9/4a50fa50-01b1-5ed1-abe2-da34c00de5c9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e1/65e1e208eee58a598e166782bbbdeeb1/pa/UB92069_86a38732cff954b91f86e23246dc7f69.jpg',
             'Width': 338}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2023}
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB92069%27 HTTP/1.1" 200 None
2025-12-05 20:08:01 [auto1.it] INFO: Saving data for UB92069: {'created_time': 1764965281.912777, 'last_price_update_time': 1764965281.912787, 'auction_closing_time': 1765038818.0}
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB92069') HTTP/1.1" 204 0
2025-12-05 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_0c332a3f45822a9ffe32b8e37428de6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_02faad4f6b15c211fbac996ecf750e42.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ09819> (referer: https://www.auto1.com/v1/car-details-view/DZ09819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ43068> (referer: https://www.auto1.com/v1/car-details-view/GZ43068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR37481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM01211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f2dd0>
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9c%252Fdf9c18d2b56fb59c1e7bdcbbea8db5cf%252Fpa%252FHD68470_de7ed9241f63f40fc14cbedc9e19e2b6.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_de7ed9241f63f40fc14cbedc9e19e2b6.jpg saved to cache
2025-12-05 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9f4ddb5-1f94-542a-ac72-2d0600a07556
2025-12-05 20:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9f4ddb5-1f94-542a-ac72-2d0600a07556, skipping ID generation
2025-12-05 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f4ddb5-1f94-542a-ac72-2d0600a07556 with scrape type 1
2025-12-05 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c9f4ddb5-1f94-542a-ac72-2d0600a07556 from tracking dictionaries
2025-12-05 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9f4ddb5-1f94-542a-ac72-2d0600a07556 sending to next pipeline
2025-12-05 20:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c9f4ddb5-1f94-542a-ac72-2d0600a07556, identifier: HD68470
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03c9410>
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_6f268b8c3b3a105f6c8b19f34c322028.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_6f268b8c3b3a105f6c8b19f34c322028.jpg saved to cache
2025-12-05 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01ef3d0>
2025-12-05 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_72fab4e32c7676085a2e1a339e39f97a.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_72fab4e32c7676085a2e1a339e39f97a.jpg saved to cache
2025-12-05 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0578990>
2025-12-05 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_1c7588f150e89a0f694d87a2aabd9846.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1c7588f150e89a0f694d87a2aabd9846.jpg saved to cache
2025-12-05 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3010d0ca-48a5-5885-aa55-4619415c0f0d with identifier: SC12614
2025-12-05 20:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3010d0ca-48a5-5885-aa55-4619415c0f0d with scrape type 2
2025-12-05 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3010d0ca-48a5-5885-aa55-4619415c0f0d with scrape type 2
2025-12-05 20:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3010d0ca-48a5-5885-aa55-4619415c0f0d, identifier: SC12614
2025-12-05 20:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c9f4ddb5-1f94-542a-ac72-2d0600a07556 with identifier: HD68470
2025-12-05 20:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c9f4ddb5-1f94-542a-ac72-2d0600a07556 with identifier: HD68470
2025-12-05 20:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c9f4ddb5-1f94-542a-ac72-2d0600a07556 with identifier: HD68470 to the API
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_de7ed9241f63f40fc14cbedc9e19e2b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:17:32Z',
 'fuel_type': 'diesel',
 'id': 'c9f4ddb5-1f94-542a-ac72-2d0600a07556',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD68470',
 'listing': 'auction',
 'location': 'IT, Sassari',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 28909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298205,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_8d305f961921dcf3c5b24745cb11e468.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270318,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_de7ed9241f63f40fc14cbedc9e19e2b6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_4967e25b3caf1805bf2c9486104f2f18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203410,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ea424d09942a319784a5af1f37af28b6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_f7405ee4e99a27316e0ba41a439b8565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_1e313b44be6bb3f7abc4c7cc6731e24d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_67c6a558fc890f2ec43c121f21e83744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283466,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_90ab1b540f5972f8d552d2e8de826959.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_263190986fec4edb4cdf83ef9b4333a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263975,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_9605fc6aff460b9f571b9165e9f2f567.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280975,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_e1a3476311d86a94c99aa84e53c86c56.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_ae024767e434a4112907022bdb666b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_613df7a96d668a6b8932d60a181119c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243646,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_a17056d4d0a7fa6bb16a56848d68becd.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f4ddb5-1f94-542a-ac72-2d0600a07556/c9f4ddb5-1f94-542a-ac72-2d0600a07556_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9c/df9c18d2b56fb59c1e7bdcbbea8db5cf/pa/HD68470_bd1feb9cbef2b40d851667d2ab2df1f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2022}
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD68470%27 HTTP/1.1" 200 None
2025-12-05 20:08:03 [auto1.it] INFO: Saving data for HD68470: {'created_time': 1764965283.876134, 'last_price_update_time': 1764965283.876147, 'auction_closing_time': 1765037852.0}
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HD68470') HTTP/1.1" 204 0
2025-12-05 20:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3010d0ca-48a5-5885-aa55-4619415c0f0d with identifier: SC12614
2025-12-05 20:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3010d0ca-48a5-5885-aa55-4619415c0f0d with identifier: SC12614
2025-12-05 20:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3010d0ca-48a5-5885-aa55-4619415c0f0d with identifier: SC12614 to the API
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC12614>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:20:22Z',
 'fuel_type': 'petrol',
 'id': '3010d0ca-48a5-5885-aa55-4619415c0f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC12614',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 106940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2021}
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC12614%27 HTTP/1.1" 200 None
2025-12-05 20:08:04 [auto1.it] INFO: Saving data for SC12614: {'auction_closing_time': 1765038022.0, 'created_time': 1761386519.078444, 'last_price_update_time': 1764965284.288079}
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC12614') HTTP/1.1" 204 0
2025-12-05 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_ea959487d7fe47a948de36fd9ed090ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae015c9d0>
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_0c332a3f45822a9ffe32b8e37428de6e.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_0c332a3f45822a9ffe32b8e37428de6e.jpg saved to cache
2025-12-05 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f68d0>
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F46%252F8d46b519d3407a142842f5a8f2d1d3bd%252Fpa%252FAJ19818_02faad4f6b15c211fbac996ecf750e42.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_02faad4f6b15c211fbac996ecf750e42.jpg saved to cache
2025-12-05 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 496318aa-90cd-522e-9de0-7682772070f3
2025-12-05 20:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 496318aa-90cd-522e-9de0-7682772070f3, skipping ID generation
2025-12-05 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496318aa-90cd-522e-9de0-7682772070f3 with scrape type 1
2025-12-05 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 496318aa-90cd-522e-9de0-7682772070f3 from tracking dictionaries
2025-12-05 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 496318aa-90cd-522e-9de0-7682772070f3 sending to next pipeline
2025-12-05 20:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 496318aa-90cd-522e-9de0-7682772070f3, identifier: AJ19818
2025-12-05 20:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 with identifier: DZ09819
2025-12-05 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 with scrape type 1
2025-12-05 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_47050760759655c873e8387a9f5e4018.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_47050760759655c873e8387a9f5e4018.jpg not downloaded yet
2025-12-05 20:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 with identifier: GZ43068
2025-12-05 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e06b709-0901-5d98-b929-eb3d054ad2b9 with scrape type 1
2025-12-05 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_68cde55361fe9bb8857bdef151d8290d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_68cde55361fe9bb8857bdef151d8290d.jpg not downloaded yet
2025-12-05 20:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 496318aa-90cd-522e-9de0-7682772070f3 with identifier: AJ19818
2025-12-05 20:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 496318aa-90cd-522e-9de0-7682772070f3 with identifier: AJ19818
2025-12-05 20:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 496318aa-90cd-522e-9de0-7682772070f3 with identifier: AJ19818 to the API
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_02faad4f6b15c211fbac996ecf750e42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2025-12-06T16:44:00Z',
 'fuel_type': 'diesel',
 'id': '496318aa-90cd-522e-9de0-7682772070f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ19818',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 18717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40826,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_5d59a222d605368fbba239df7d3264b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40826,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_0c332a3f45822a9ffe32b8e37428de6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41211,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_02faad4f6b15c211fbac996ecf750e42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38130,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_67a41564890b748771ee8ff5e39263fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32182,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_6f268b8c3b3a105f6c8b19f34c322028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40104,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1c7588f150e89a0f694d87a2aabd9846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38491,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_4ba7c8df41dc555e35b3553b5f02788d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40648,
             'Height': 530,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_45e62820d01bd12da830c71479235162.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33460,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_c261fc909a148065770e4e4eb4339b71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51558,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_1b98dbf947db8bcb27f28f30283a318f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39143,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_14aff9fb00f9f6e4e142d5f084d42c45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36193,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_d16c2c9a00d204ba42c6ee7f007289e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39570,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_ee1e9b72278a11393137934dbbce0aaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27574,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_996bc9055998c22e183b066755562018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_496318aa-90cd-522e-9de0-7682772070f3/496318aa-90cd-522e-9de0-7682772070f3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/46/8d46b519d3407a142842f5a8f2d1d3bd/pa/AJ19818_63119ec271c2e3a25e0038762f3c5d3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ19818%27 HTTP/1.1" 200 None
2025-12-05 20:08:05 [auto1.it] INFO: Saving data for AJ19818: {'created_time': 1764965285.554625, 'last_price_update_time': 1764965285.554636, 'auction_closing_time': 1765039440.0}
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ19818') HTTP/1.1" 204 0
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_3156bfb08bc04389dd29769fd874e6ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_3156bfb08bc04389dd29769fd874e6ad.jpg not downloaded yet
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_7de0e84b1fc195274efaed46aec3f02f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7de0e84b1fc195274efaed46aec3f02f.jpg not downloaded yet
2025-12-05 20:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US78737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR41541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_7a0022ade83abc69bb64e17e644212ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7a0022ade83abc69bb64e17e644212ac.jpg not downloaded yet
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_8e88107bdc045b571c43202ee9329ae2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_8e88107bdc045b571c43202ee9329ae2.jpg not downloaded yet
2025-12-05 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW41289> (referer: https://www.auto1.com/v1/car-details-view/HW41289/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37b2fd0>
2025-12-05 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F39%252Fd1390e392bb5660a47ad7120d46df5f9%252Fpa%252FZZ94683_ea959487d7fe47a948de36fd9ed090ed.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_ea959487d7fe47a948de36fd9ed090ed.jpg saved to cache
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a01a9f7-3120-50a5-90cb-29e183ee3611
2025-12-05 20:08:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a01a9f7-3120-50a5-90cb-29e183ee3611, skipping ID generation
2025-12-05 20:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a01a9f7-3120-50a5-90cb-29e183ee3611 with scrape type 1
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a01a9f7-3120-50a5-90cb-29e183ee3611 from tracking dictionaries
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a01a9f7-3120-50a5-90cb-29e183ee3611 sending to next pipeline
2025-12-05 20:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a01a9f7-3120-50a5-90cb-29e183ee3611, identifier: ZZ94683
2025-12-05 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_47050760759655c873e8387a9f5e4018.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_cc25d467588298c0b5331432ded7fcf3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_cc25d467588298c0b5331432ded7fcf3.jpg not downloaded yet
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_7f1fe4ed76092c7dbb3e2ecf245f5c8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f1fe4ed76092c7dbb3e2ecf245f5c8f.jpg not downloaded yet
2025-12-05 20:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a01a9f7-3120-50a5-90cb-29e183ee3611 with identifier: ZZ94683
2025-12-05 20:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a01a9f7-3120-50a5-90cb-29e183ee3611 with identifier: ZZ94683
2025-12-05 20:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a01a9f7-3120-50a5-90cb-29e183ee3611 with identifier: ZZ94683 to the API
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_ea959487d7fe47a948de36fd9ed090ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:24:28Z',
 'fuel_type': 'hybrid',
 'id': '3a01a9f7-3120-50a5-90cb-29e183ee3611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ94683',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 48657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 972403,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0f6998a62c6b1bdf8ebdc014f87a386c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 972403,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8d7c71ada34e3c2ff38ebd7cc1c35447.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1098226,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_f6aa9bfbc0ac40798a368c85964a1969.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103286,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_807f71d29159354e58675e67bd4475de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1016124,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_2421a5bd779f9c8918a16beada737e92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 949614,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_ea959487d7fe47a948de36fd9ed090ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86171,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_186a179e81fedf33aa6f7461b8dd4951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90970,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_0e626d646dab4ea55a8d4bdb387dce12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660248,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_8cb010d796b2a8eb4ee2bc3558e06d95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_68ac786d78bb227f71aaa7458181c9f3.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621588,
             'Height': 1152,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_4a844700a3847af67c816ea721c08a5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28339,
             'Height': 404,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_49992028951a6674e04143e7dcfd0db5.jpg',
             'Width': 733},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50963,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_7c330a008a2aa851884f09eb335c7f8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a01a9f7-3120-50a5-90cb-29e183ee3611/3a01a9f7-3120-50a5-90cb-29e183ee3611_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/39/d1390e392bb5660a47ad7120d46df5f9/pa/ZZ94683_3d0de4c95df82000acaf64efdc035c5f.jpg',
             'Width': 338}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ94683%27 HTTP/1.1" 200 None
2025-12-05 20:08:06 [auto1.it] INFO: Saving data for ZZ94683: {'created_time': 1764965286.535633, 'last_price_update_time': 1764965286.535646, 'auction_closing_time': 1765038268.0}
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ94683') HTTP/1.1" 204 0
2025-12-05 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_68cde55361fe9bb8857bdef151d8290d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_b6d3b6b3c5ba164d9880543cfb79c8b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_b6d3b6b3c5ba164d9880543cfb79c8b1.jpg not downloaded yet
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_7f27404a72f6a63c4f0d77422322a012.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f27404a72f6a63c4f0d77422322a012.jpg not downloaded yet
2025-12-05 20:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6407ff5-0f31-5e06-a95f-97b147e061b8 with identifier: HW41289
2025-12-05 20:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6407ff5-0f31-5e06-a95f-97b147e061b8 with scrape type 1
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_3edc43abfec12eab4c781c40570f803f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_3edc43abfec12eab4c781c40570f803f.jpg not downloaded yet
2025-12-05 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022c710>
2025-12-05 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_47050760759655c873e8387a9f5e4018.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_47050760759655c873e8387a9f5e4018.jpg saved to cache
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7a0022ade83abc69bb64e17e644212ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_7e165a7ad46d73bd0e12ae776a34926e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7e165a7ad46d73bd0e12ae776a34926e.jpg not downloaded yet
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_a86721bacd1acf01cea25a793b84e33a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_a86721bacd1acf01cea25a793b84e33a.jpg not downloaded yet
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_ca779719739a839fe80f04ddec4cb986.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_ca779719739a839fe80f04ddec4cb986.jpg not downloaded yet
2025-12-05 20:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7de0e84b1fc195274efaed46aec3f02f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_8e88107bdc045b571c43202ee9329ae2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_5ba9e22fe8580efcacaffb945e587b3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_5ba9e22fe8580efcacaffb945e587b3a.jpg not downloaded yet
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_f1cdc59bae72410df3d5c33c2c2f5def.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_f1cdc59bae72410df3d5c33c2c2f5def.jpg not downloaded yet
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae04fa350>
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_68cde55361fe9bb8857bdef151d8290d.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_68cde55361fe9bb8857bdef151d8290d.jpg saved to cache
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_f88936af93ff6586b7bf5c2d1f7a024a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_f88936af93ff6586b7bf5c2d1f7a024a.jpg not downloaded yet
2025-12-05 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f1fe4ed76092c7dbb3e2ecf245f5c8f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_bb66be48592f356bc450b9e9cb41946c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_bb66be48592f356bc450b9e9cb41946c.jpg not downloaded yet
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_524121cb7d78e562c0c945990e762819.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_524121cb7d78e562c0c945990e762819.jpg not downloaded yet
2025-12-05 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f27404a72f6a63c4f0d77422322a012.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_bf228d7cb05f7516668f1a7104c5b0d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_bf228d7cb05f7516668f1a7104c5b0d7.jpg not downloaded yet
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_f8f4a5c7fbb0fbaf64f0c0e1ab3a84a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f8f4a5c7fbb0fbaf64f0c0e1ab3a84a0.jpg not downloaded yet
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_b2f46cbc5c0caa32691ea3753750e3b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_b2f46cbc5c0caa32691ea3753750e3b8.jpg not downloaded yet
2025-12-05 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW34893> (referer: https://www.auto1.com/v1/car-details-view/WW34893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_746177f8d0e9075f4e98fdf062e272b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_746177f8d0e9075f4e98fdf062e272b6.jpg not downloaded yet
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0079fd0>
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_7a0022ade83abc69bb64e17e644212ac.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7a0022ade83abc69bb64e17e644212ac.jpg saved to cache
2025-12-05 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d4cd0>
2025-12-05 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_7de0e84b1fc195274efaed46aec3f02f.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7de0e84b1fc195274efaed46aec3f02f.jpg saved to cache
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae012d450>
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_8e88107bdc045b571c43202ee9329ae2.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_8e88107bdc045b571c43202ee9329ae2.jpg saved to cache
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_9a8629769b6cab7280617e804cf9ff18.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_9a8629769b6cab7280617e804cf9ff18.jpg not downloaded yet
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_08387f9378c7237f748539b619de7b77.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_08387f9378c7237f748539b619de7b77.jpg not downloaded yet
2025-12-05 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_b6d3b6b3c5ba164d9880543cfb79c8b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_20856989e074eaa6bcd9177ef5461349.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_20856989e074eaa6bcd9177ef5461349.jpg not downloaded yet
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0523050>
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_7f1fe4ed76092c7dbb3e2ecf245f5c8f.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f1fe4ed76092c7dbb3e2ecf245f5c8f.jpg saved to cache
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_a86721bacd1acf01cea25a793b84e33a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_66e7e75580549e53d09d6b7de77d933c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_66e7e75580549e53d09d6b7de77d933c.jpg not downloaded yet
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_c83262db504fd9b9ac21a0208a12db73.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_c83262db504fd9b9ac21a0208a12db73.jpg not downloaded yet
2025-12-05 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP00862> (referer: https://www.auto1.com/v1/car-details-view/YP00862/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_44277b369e35c5e2b6b92c57be74bca8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_44277b369e35c5e2b6b92c57be74bca8.jpg not downloaded yet
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03cc4d0>
2025-12-05 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_7f27404a72f6a63c4f0d77422322a012.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f27404a72f6a63c4f0d77422322a012.jpg saved to cache
2025-12-05 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e200b3d7-b9d0-5454-933b-f940b9bd17a2 with identifier: WW34893
2025-12-05 20:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e200b3d7-b9d0-5454-933b-f940b9bd17a2 with scrape type 2
2025-12-05 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e200b3d7-b9d0-5454-933b-f940b9bd17a2 with scrape type 2
2025-12-05 20:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e200b3d7-b9d0-5454-933b-f940b9bd17a2, identifier: WW34893
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_a41441d616233dc65c557a5bb0caeae4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_a41441d616233dc65c557a5bb0caeae4.jpg not downloaded yet
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_83898cfe953c5475ec3652441568f734.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_83898cfe953c5475ec3652441568f734.jpg not downloaded yet
2025-12-05 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM01211> (referer: https://www.auto1.com/v1/car-details-view/EM01211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e200b3d7-b9d0-5454-933b-f940b9bd17a2 with identifier: WW34893
2025-12-05 20:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e200b3d7-b9d0-5454-933b-f940b9bd17a2 with identifier: WW34893
2025-12-05 20:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e200b3d7-b9d0-5454-933b-f940b9bd17a2 with identifier: WW34893 to the API
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW34893>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2025-12-06T16:16:11Z',
 'fuel_type': 'petrol',
 'id': 'e200b3d7-b9d0-5454-933b-f940b9bd17a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW34893',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 86289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW34893%27 HTTP/1.1" 200 None
2025-12-05 20:08:09 [auto1.it] INFO: Saving data for WW34893: {'auction_closing_time': 1765037771.0, 'created_time': 1760731638.557906, 'last_price_update_time': 1764965289.788701}
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW34893') HTTP/1.1" 204 0
2025-12-05 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0079110>
2025-12-05 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_b6d3b6b3c5ba164d9880543cfb79c8b1.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_b6d3b6b3c5ba164d9880543cfb79c8b1.jpg saved to cache
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_f88936af93ff6586b7bf5c2d1f7a024a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_532db61e5e2bfb4454dd9580087070ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_532db61e5e2bfb4454dd9580087070ba.jpg not downloaded yet
2025-12-05 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_f1cdc59bae72410df3d5c33c2c2f5def.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_f7ead539f224c48456420c3a70994d27.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f7ead539f224c48456420c3a70994d27.jpg not downloaded yet
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_64016d01a51ace14cff5708b1f92cdac.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_64016d01a51ace14cff5708b1f92cdac.jpg not downloaded yet
2025-12-05 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03ec950>
2025-12-05 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_a86721bacd1acf01cea25a793b84e33a.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_a86721bacd1acf01cea25a793b84e33a.jpg saved to cache
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb4dc81-3983-503c-ba5a-e8750026bcf7 with identifier: YP00862
2025-12-05 20:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb4dc81-3983-503c-ba5a-e8750026bcf7 with scrape type 1
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0eb4dc81-3983-503c-ba5a-e8750026bcf7
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_38a3f3ed18033a18d0af62357dbd3d4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_38a3f3ed18033a18d0af62357dbd3d4c.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_2168bfbd3318a1649603f2763d830c06.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_2168bfbd3318a1649603f2763d830c06.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_bc2db78ade0c12899f9f002a7d599480.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_bc2db78ade0c12899f9f002a7d599480.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_84d2ee29204afd65158777319cecd9c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_84d2ee29204afd65158777319cecd9c7.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_ccc9587bfe3f4c86eb7514789c3b5490.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_ccc9587bfe3f4c86eb7514789c3b5490.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_c5cc5410f5a7f319660f5674a1621da8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_c5cc5410f5a7f319660f5674a1621da8.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_d0db1403436faf5b25ca96d2f3260bb3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_d0db1403436faf5b25ca96d2f3260bb3.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_6067f9a55492246cdae56c263f338aa5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_6067f9a55492246cdae56c263f338aa5.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_ecf8270003ed014d16691042a36fdb5d.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_ecf8270003ed014d16691042a36fdb5d.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_521747ee929230c884f53ae9e91572e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_521747ee929230c884f53ae9e91572e8.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_562e82cdc86d173404db87366ebf8332.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_562e82cdc86d173404db87366ebf8332.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_8f1aba0b06ab8ab235a7e65d5ab18851.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_8f1aba0b06ab8ab235a7e65d5ab18851.jpg already downloaded
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F4e%252F1f4e83f153c30f2ac1ba5545609ead99%252Fpa%252FYP00862_136edce62c4999b1b5f57bf58c5056be.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_136edce62c4999b1b5f57bf58c5056be.jpg already downloaded
2025-12-05 20:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0eb4dc81-3983-503c-ba5a-e8750026bcf7, identifier: YP00862
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_4fa11fa3dcb4732a0b7b818d959080b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_4fa11fa3dcb4732a0b7b818d959080b1.jpg not downloaded yet
2025-12-05 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR41541> (referer: https://www.auto1.com/v1/car-details-view/KR41541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR37481> (referer: https://www.auto1.com/v1/car-details-view/FR37481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US78737> (referer: https://www.auto1.com/v1/car-details-view/US78737/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 20:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0eb4dc81-3983-503c-ba5a-e8750026bcf7 with identifier: YP00862
2025-12-05 20:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0eb4dc81-3983-503c-ba5a-e8750026bcf7 with identifier: YP00862
2025-12-05 20:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 197620 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197620
2025-12-05 20:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0eb4dc81-3983-503c-ba5a-e8750026bcf7 spider: auto1.it
2025-12-05 20:08:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0eb4dc81-3983-503c-ba5a-e8750026bcf7 due to rule: high_mileage_for_country.json, error: 197620 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197620
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:11:02Z',
 'fuel_type': 'diesel',
 'id': '0eb4dc81-3983-503c-ba5a-e8750026bcf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP00862',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 197620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_38a3f3ed18033a18d0af62357dbd3d4c.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_2168bfbd3318a1649603f2763d830c06.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_bc2db78ade0c12899f9f002a7d599480.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_84d2ee29204afd65158777319cecd9c7.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_ccc9587bfe3f4c86eb7514789c3b5490.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_c5cc5410f5a7f319660f5674a1621da8.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_d0db1403436faf5b25ca96d2f3260bb3.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_6067f9a55492246cdae56c263f338aa5.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_ecf8270003ed014d16691042a36fdb5d.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_521747ee929230c884f53ae9e91572e8.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_562e82cdc86d173404db87366ebf8332.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_8f1aba0b06ab8ab235a7e65d5ab18851.jpg',
                'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_136edce62c4999b1b5f57bf58c5056be.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4246571,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_38a3f3ed18033a18d0af62357dbd3d4c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4246571,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_2168bfbd3318a1649603f2763d830c06.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_bc2db78ade0c12899f9f002a7d599480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_84d2ee29204afd65158777319cecd9c7.jpg',
             'Width': 770},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_ccc9587bfe3f4c86eb7514789c3b5490.jpg',
             'Width': 729},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3467217,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_c5cc5410f5a7f319660f5674a1621da8.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3774742,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_d0db1403436faf5b25ca96d2f3260bb3.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_6067f9a55492246cdae56c263f338aa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3266021,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_ecf8270003ed014d16691042a36fdb5d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_521747ee929230c884f53ae9e91572e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3122775,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_562e82cdc86d173404db87366ebf8332.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2932317,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_8f1aba0b06ab8ab235a7e65d5ab18851.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb4dc81-3983-503c-ba5a-e8750026bcf7/0eb4dc81-3983-503c-ba5a-e8750026bcf7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/4e/1f4e83f153c30f2ac1ba5545609ead99/pa/YP00862_136edce62c4999b1b5f57bf58c5056be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.6 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP00862%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [auto1.it] INFO: Saving data for YP00862: {'created_time': 1764965291.147468, 'last_price_update_time': 1764965291.147479, 'auction_closing_time': 1765037462.0}
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YP00862') HTTP/1.1" 204 0
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_2c37c8a433f6d549c4bfedfb9260c088.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_2c37c8a433f6d549c4bfedfb9260c088.jpg not downloaded yet
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_66b769fef5b61ba1811a7f93a07ccfb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_66b769fef5b61ba1811a7f93a07ccfb0.jpg not downloaded yet
2025-12-05 20:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 698a8bd7-82c5-543a-b86e-fefcc4f45694 with identifier: EM01211
2025-12-05 20:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 698a8bd7-82c5-543a-b86e-fefcc4f45694 with scrape type 1
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 698a8bd7-82c5-543a-b86e-fefcc4f45694
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_ad55a180c8fd8f7a82c838e3aa26c3ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_ad55a180c8fd8f7a82c838e3aa26c3ed.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_d02ef33db75e7eca1f71102a38ad77a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_d02ef33db75e7eca1f71102a38ad77a1.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_d8a4773123cfdf9eccdd601a1f41d1f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_d8a4773123cfdf9eccdd601a1f41d1f6.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_6d2922b1b64126953e824f24f7365c10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6d2922b1b64126953e824f24f7365c10.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_0a3dbe589b06eb0675d0cd85bd91e196.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_0a3dbe589b06eb0675d0cd85bd91e196.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_6d78f175159a5e63280ce777cd03b782.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6d78f175159a5e63280ce777cd03b782.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_6cf9a5f414e01768343f18b5ecfff078.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6cf9a5f414e01768343f18b5ecfff078.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_aff680f361c1bdf24b5910df7cd12c42.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_aff680f361c1bdf24b5910df7cd12c42.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_68bceffbc66a1ec88d7f46ca6fea7b8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_68bceffbc66a1ec88d7f46ca6fea7b8f.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_02d7a51b26b217e3852535392bd9b43e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_02d7a51b26b217e3852535392bd9b43e.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_e269874404e212066a2a2f613a7aa839.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_e269874404e212066a2a2f613a7aa839.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_c9e37c5dbf9c3e2c9487c947b6f8c973.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_c9e37c5dbf9c3e2c9487c947b6f8c973.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_03407656876ac0e12ce24ebb48aeba03.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_03407656876ac0e12ce24ebb48aeba03.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_99df706730ef10870fcaeae3a2b91612.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_99df706730ef10870fcaeae3a2b91612.jpg already downloaded
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fe8%252F26e8337f87dd933da2d79fd5118805d0%252Fpa%252FEM01211_2db24f11907caa4994c9b3fe6a21f2ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_2db24f11907caa4994c9b3fe6a21f2ab.jpg already downloaded
2025-12-05 20:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 698a8bd7-82c5-543a-b86e-fefcc4f45694, identifier: EM01211
2025-12-05 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_bf228d7cb05f7516668f1a7104c5b0d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_746177f8d0e9075f4e98fdf062e272b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_03426ba372d95517f0b60f9434aaf5f8.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_03426ba372d95517f0b60f9434aaf5f8.jpg not downloaded yet
2025-12-05 20:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 698a8bd7-82c5-543a-b86e-fefcc4f45694 with identifier: EM01211
2025-12-05 20:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 698a8bd7-82c5-543a-b86e-fefcc4f45694 with identifier: EM01211
2025-12-05 20:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 698a8bd7-82c5-543a-b86e-fefcc4f45694 with identifier: EM01211 to the API
2025-12-05 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM01211>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:40:51Z',
 'fuel_type': 'diesel',
 'id': '698a8bd7-82c5-543a-b86e-fefcc4f45694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM01211',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 109956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_ad55a180c8fd8f7a82c838e3aa26c3ed.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_d02ef33db75e7eca1f71102a38ad77a1.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_d8a4773123cfdf9eccdd601a1f41d1f6.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6d2922b1b64126953e824f24f7365c10.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_0a3dbe589b06eb0675d0cd85bd91e196.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6d78f175159a5e63280ce777cd03b782.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6cf9a5f414e01768343f18b5ecfff078.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_aff680f361c1bdf24b5910df7cd12c42.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_68bceffbc66a1ec88d7f46ca6fea7b8f.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_02d7a51b26b217e3852535392bd9b43e.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_e269874404e212066a2a2f613a7aa839.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_c9e37c5dbf9c3e2c9487c947b6f8c973.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_03407656876ac0e12ce24ebb48aeba03.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_99df706730ef10870fcaeae3a2b91612.jpg',
                'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_2db24f11907caa4994c9b3fe6a21f2ab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_ad55a180c8fd8f7a82c838e3aa26c3ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_d02ef33db75e7eca1f71102a38ad77a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_d8a4773123cfdf9eccdd601a1f41d1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6d2922b1b64126953e824f24f7365c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_0a3dbe589b06eb0675d0cd85bd91e196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6d78f175159a5e63280ce777cd03b782.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_6cf9a5f414e01768343f18b5ecfff078.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_aff680f361c1bdf24b5910df7cd12c42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_68bceffbc66a1ec88d7f46ca6fea7b8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_02d7a51b26b217e3852535392bd9b43e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_e269874404e212066a2a2f613a7aa839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_c9e37c5dbf9c3e2c9487c947b6f8c973.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_03407656876ac0e12ce24ebb48aeba03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_99df706730ef10870fcaeae3a2b91612.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698a8bd7-82c5-543a-b86e-fefcc4f45694/698a8bd7-82c5-543a-b86e-fefcc4f45694_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/e8/26e8337f87dd933da2d79fd5118805d0/pa/EM01211_2db24f11907caa4994c9b3fe6a21f2ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2017}
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM01211%27 HTTP/1.1" 200 None
2025-12-05 20:08:12 [auto1.it] INFO: Saving data for EM01211: {'created_time': 1764965292.26716, 'last_price_update_time': 1764965292.267169, 'auction_closing_time': 1765039251.0}
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EM01211') HTTP/1.1" 204 0
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0222210>
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_f88936af93ff6586b7bf5c2d1f7a024a.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_f88936af93ff6586b7bf5c2d1f7a024a.jpg saved to cache
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3627990>
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_f1cdc59bae72410df3d5c33c2c2f5def.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_f1cdc59bae72410df3d5c33c2c2f5def.jpg saved to cache
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_4b742598e5bbdc25d363bdd28817c6a0.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_4b742598e5bbdc25d363bdd28817c6a0.jpg not downloaded yet
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_d52b7c2f16556b4fc67734f736434087.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_d52b7c2f16556b4fc67734f736434087.jpg not downloaded yet
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_d991de58cdba2ab5a22d485f0a7c106c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_d991de58cdba2ab5a22d485f0a7c106c.jpg not downloaded yet
2025-12-05 20:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b42b3de-f69f-56b9-97bb-67fd371cd3cf with identifier: KR41541
2025-12-05 20:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b42b3de-f69f-56b9-97bb-67fd371cd3cf with scrape type 2
2025-12-05 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b42b3de-f69f-56b9-97bb-67fd371cd3cf with scrape type 2
2025-12-05 20:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b42b3de-f69f-56b9-97bb-67fd371cd3cf, identifier: KR41541
2025-12-05 20:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b5030f-c480-5080-a2f0-67331b1e71a9 with identifier: FR37481
2025-12-05 20:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b5030f-c480-5080-a2f0-67331b1e71a9 with scrape type 1
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_3ed57cb161914ed9cdad42b6b7697f35.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_3ed57cb161914ed9cdad42b6b7697f35.jpg not downloaded yet
2025-12-05 20:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f35996f-adae-5f6c-843d-148d26ffb480 with identifier: US78737
2025-12-05 20:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f35996f-adae-5f6c-843d-148d26ffb480 with scrape type 1
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_ef3bca3ec6c7cb7a28ab5dc5e330db66.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_ef3bca3ec6c7cb7a28ab5dc5e330db66.jpg not downloaded yet
2025-12-05 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_0ac6762806c9a7cb73be6342fcfe0e30.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b42b3de-f69f-56b9-97bb-67fd371cd3cf with identifier: KR41541
2025-12-05 20:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b42b3de-f69f-56b9-97bb-67fd371cd3cf with identifier: KR41541
2025-12-05 20:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2025-12-05 20:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1b42b3de-f69f-56b9-97bb-67fd371cd3cf spider: auto1.it
2025-12-05 20:08:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 1b42b3de-f69f-56b9-97bb-67fd371cd3cf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:55:07Z',
 'fuel_type': 'diesel',
 'id': '1b42b3de-f69f-56b9-97bb-67fd371cd3cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR41541',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 36732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure N1 L1',
 'transmission': 'manual',
 'trim': 'Allure N1 L1',
 'year': 2023}
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR41541%27 HTTP/1.1" 200 None
2025-12-05 20:08:13 [auto1.it] INFO: Saving data for KR41541: {'auction_closing_time': 1765040107.0, 'created_time': 1761595376.989288, 'last_price_update_time': 1764965293.426127}
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR41541') HTTP/1.1" 204 0
2025-12-05 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_20856989e074eaa6bcd9177ef5461349.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_0111fb944396b7d87b792593bb65d86b.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_0111fb944396b7d87b792593bb65d86b.jpg not downloaded yet
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_9be25c1f9188099039be562b1dfcd9d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_9be25c1f9188099039be562b1dfcd9d3.jpg not downloaded yet
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_f9ccd1805b7fbac26acb2bad09cb104e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_f9ccd1805b7fbac26acb2bad09cb104e.jpg not downloaded yet
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae014d010>
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_bf228d7cb05f7516668f1a7104c5b0d7.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_bf228d7cb05f7516668f1a7104c5b0d7.jpg saved to cache
2025-12-05 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03d4450>
2025-12-05 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_746177f8d0e9075f4e98fdf062e272b6.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_746177f8d0e9075f4e98fdf062e272b6.jpg saved to cache
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_35a5319f41f201681469d6679779a82d.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_08387f9378c7237f748539b619de7b77.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_83898cfe953c5475ec3652441568f734.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_1b89d353c8e4fab5a518d23030430f32.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_1b89d353c8e4fab5a518d23030430f32.jpg not downloaded yet
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_0f2a0bd313258e13b3c836c91564d2e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0f2a0bd313258e13b3c836c91564d2e2.jpg not downloaded yet
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_1a3e8d6df0a8d93c8e37bd6e1d850bdb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_1a3e8d6df0a8d93c8e37bd6e1d850bdb.jpg not downloaded yet
2025-12-05 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae045fd10>
2025-12-05 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F27%252Fbb27272441c78c302db9c3adfd532d3c%252Fpa%252FLP33794_0ac6762806c9a7cb73be6342fcfe0e30.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_0ac6762806c9a7cb73be6342fcfe0e30.jpg saved to cache
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95cda29a-d755-523f-af36-5b48357ba94d
2025-12-05 20:08:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95cda29a-d755-523f-af36-5b48357ba94d, skipping ID generation
2025-12-05 20:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95cda29a-d755-523f-af36-5b48357ba94d with scrape type 1
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 95cda29a-d755-523f-af36-5b48357ba94d from tracking dictionaries
2025-12-05 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95cda29a-d755-523f-af36-5b48357ba94d sending to next pipeline
2025-12-05 20:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95cda29a-d755-523f-af36-5b48357ba94d, identifier: LP33794
2025-12-05 20:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95cda29a-d755-523f-af36-5b48357ba94d with identifier: LP33794
2025-12-05 20:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95cda29a-d755-523f-af36-5b48357ba94d with identifier: LP33794
2025-12-05 20:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95cda29a-d755-523f-af36-5b48357ba94d with identifier: LP33794 to the API
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_0ac6762806c9a7cb73be6342fcfe0e30.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:31:57Z',
 'fuel_type': 'petrol',
 'id': '95cda29a-d755-523f-af36-5b48357ba94d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP33794',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 92449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_0ac6762806c9a7cb73be6342fcfe0e30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479835,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_7a12b741a0d279599080c3e578e550b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_72fab4e32c7676085a2e1a339e39f97a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_a600f64807b31f73bc49dc7ad9b6b085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_b95846e222d1f083b0b4c9558ce56dd9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_879f52bc38f2db5963be6ece361714df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_e2c449e2f33c86ef812be3c4f9a7e843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659729,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_bf8807e99bc810d1ca49084f27c8a17b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_8613520e11a7c797370db6cd47b385a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_53ca22800908b0d83bdefcc9d320171b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_5f1829ab3afb375ac166d6ac58490ae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_f928a3886334ce66b6fe93b468434073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_cf32d9def210c7eacfbeb6ff7b1622fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_ee3b2cfa68e5340702f29372dc4c38e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95cda29a-d755-523f-af36-5b48357ba94d/95cda29a-d755-523f-af36-5b48357ba94d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/27/bb27272441c78c302db9c3adfd532d3c/pa/LP33794_aa48b2956faf940d436fbfc085c66ed8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP33794%27 HTTP/1.1" 200 None
2025-12-05 20:08:15 [auto1.it] INFO: Saving data for LP33794: {'created_time': 1764965295.017148, 'last_price_update_time': 1764965295.017161, 'auction_closing_time': 1765038717.0}
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LP33794') HTTP/1.1" 204 0
2025-12-05 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_a41441d616233dc65c557a5bb0caeae4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_35079b3133cd0ec12dd49e234b7b4412.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_35079b3133cd0ec12dd49e234b7b4412.jpg not downloaded yet
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_213c006b186a7e13318f39822bbdbf4f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_213c006b186a7e13318f39822bbdbf4f.jpg not downloaded yet
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_e5b7c2f99a938a0d278b893045e2e0e3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_e5b7c2f99a938a0d278b893045e2e0e3.jpg not downloaded yet
2025-12-05 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f7ead539f224c48456420c3a70994d27.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02ed450>
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_20856989e074eaa6bcd9177ef5461349.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_20856989e074eaa6bcd9177ef5461349.jpg saved to cache
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0484bd0>
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F09%252F77090983f949052814fe85493327a336%252Fpa%252FRZ21279_35a5319f41f201681469d6679779a82d.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_35a5319f41f201681469d6679779a82d.jpg saved to cache
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ed9376d4-e3fe-5778-831d-06cec1077f02
2025-12-05 20:08:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed9376d4-e3fe-5778-831d-06cec1077f02, skipping ID generation
2025-12-05 20:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9376d4-e3fe-5778-831d-06cec1077f02 with scrape type 1
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ed9376d4-e3fe-5778-831d-06cec1077f02 from tracking dictionaries
2025-12-05 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed9376d4-e3fe-5778-831d-06cec1077f02 sending to next pipeline
2025-12-05 20:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed9376d4-e3fe-5778-831d-06cec1077f02, identifier: RZ21279
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3672a90>
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_08387f9378c7237f748539b619de7b77.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_08387f9378c7237f748539b619de7b77.jpg saved to cache
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae017dad0>
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_83898cfe953c5475ec3652441568f734.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_83898cfe953c5475ec3652441568f734.jpg saved to cache
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_64016d01a51ace14cff5708b1f92cdac.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_a2ea60be7f7b353759826d8f8f98bb44.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_a2ea60be7f7b353759826d8f8f98bb44.jpg not downloaded yet
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_f33243f4b8242dd025ea4d7b4c0ab49a.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_f33243f4b8242dd025ea4d7b4c0ab49a.jpg not downloaded yet
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_89019059869e5fd4d2b28d46a39575d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_89019059869e5fd4d2b28d46a39575d6.jpg not downloaded yet
2025-12-05 20:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed9376d4-e3fe-5778-831d-06cec1077f02 with identifier: RZ21279
2025-12-05 20:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed9376d4-e3fe-5778-831d-06cec1077f02 with identifier: RZ21279
2025-12-05 20:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2025-12-05 20:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ed9376d4-e3fe-5778-831d-06cec1077f02 spider: auto1.it
2025-12-05 20:08:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ed9376d4-e3fe-5778-831d-06cec1077f02 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:34:12Z',
 'fuel_type': 'petrol',
 'id': 'ed9376d4-e3fe-5778-831d-06cec1077f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ21279',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 103707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_f7c8db1a60d64e66d7681a2dccb4e28a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_7aead62d8147b6dc7e2ca363205f4c74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_b9b882081c17bdc6f848848662a155e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2886314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_18e6b77ceff7c6b19b9105eaed04154f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3082643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_3c81a9aafda65e5b4707cdbe4be97e17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3068643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d2a7c78f83944858adf1a1a5bf28a8a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_ea58e97c0b2ecf871e9e88daeada713c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8a881d534e52d05fe9557de7f042b897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_d5c0bab727916ed5d2e8d0b6ad6e7738.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8eb39852061cf9e856ecb2587780b537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_35a5319f41f201681469d6679779a82d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_c53893a8b3b365c4bf5a64ec954a2c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_a4baf9936d2fd0e02020d49cc8af8479.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730231,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_507577488821e1cdb2356515bba1dad7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9376d4-e3fe-5778-831d-06cec1077f02/ed9376d4-e3fe-5778-831d-06cec1077f02_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/09/77090983f949052814fe85493327a336/pa/RZ21279_8c70e79f468330b08f599aa38ee1dd1d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ21279%27 HTTP/1.1" 200 None
2025-12-05 20:08:16 [auto1.it] INFO: Saving data for RZ21279: {'created_time': 1764965296.801277, 'last_price_update_time': 1764965296.801287, 'auction_closing_time': 1765038852.0}
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ21279') HTTP/1.1" 204 0
2025-12-05 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_532db61e5e2bfb4454dd9580087070ba.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_fdbb80656d5c24d0b7dd0287b8ed8021.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fdbb80656d5c24d0b7dd0287b8ed8021.jpg not downloaded yet
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_0e8c6622508ec91e0fbe22c320b93343.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_0e8c6622508ec91e0fbe22c320b93343.jpg not downloaded yet
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad364ae50>
2025-12-05 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_a41441d616233dc65c557a5bb0caeae4.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_a41441d616233dc65c557a5bb0caeae4.jpg saved to cache
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae022d910>
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_f7ead539f224c48456420c3a70994d27.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f7ead539f224c48456420c3a70994d27.jpg saved to cache
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_ed7816526e0765e9236a50f433b1f6f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_ed7816526e0765e9236a50f433b1f6f6.jpg not downloaded yet
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_3738ff31547191b7ea3c2c78282f7870.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3738ff31547191b7ea3c2c78282f7870.jpg not downloaded yet
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f6b90>
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_64016d01a51ace14cff5708b1f92cdac.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_64016d01a51ace14cff5708b1f92cdac.jpg saved to cache
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_c83262db504fd9b9ac21a0208a12db73.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_d52b7c2f16556b4fc67734f736434087.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_90783b72f6f807053c5ff9a9846bc30c.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_90783b72f6f807053c5ff9a9846bc30c.jpg not downloaded yet
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_b384c8779b7f556146d01278d5cee406.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_b384c8779b7f556146d01278d5cee406.jpg not downloaded yet
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3653510>
2025-12-05 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_532db61e5e2bfb4454dd9580087070ba.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_532db61e5e2bfb4454dd9580087070ba.jpg saved to cache
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_ef3bca3ec6c7cb7a28ab5dc5e330db66.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_83197c4b8f57600cba03e9093ffe381e.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_83197c4b8f57600cba03e9093ffe381e.jpg not downloaded yet
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_3b0321e2d7c1559bd64b2562df1fb0d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3b0321e2d7c1559bd64b2562df1fb0d3.jpg not downloaded yet
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_4b89a312bfa43ebb10c97c19e3ac37fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_4b89a312bfa43ebb10c97c19e3ac37fe.jpg not downloaded yet
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_46e0accc521ef0f5a951576b086acb14.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_46e0accc521ef0f5a951576b086acb14.jpg not downloaded yet
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad37281d0>
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_c83262db504fd9b9ac21a0208a12db73.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_c83262db504fd9b9ac21a0208a12db73.jpg saved to cache
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0571c50>
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_d52b7c2f16556b4fc67734f736434087.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_d52b7c2f16556b4fc67734f736434087.jpg saved to cache
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_e5b7c2f99a938a0d278b893045e2e0e3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_213c006b186a7e13318f39822bbdbf4f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_031e630dd3be8f5907452e671c004aea.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_031e630dd3be8f5907452e671c004aea.jpg not downloaded yet
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_2d992a95e18063b554924b20a9147a87.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_2d992a95e18063b554924b20a9147a87.jpg not downloaded yet
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_23a669e1d912af7b153c9e663169b9a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_23a669e1d912af7b153c9e663169b9a4.jpg not downloaded yet
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_411c691605fd392324b7014391446762.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_411c691605fd392324b7014391446762.jpg not downloaded yet
2025-12-05 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_3156bfb08bc04389dd29769fd874e6ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0131790>
2025-12-05 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_ef3bca3ec6c7cb7a28ab5dc5e330db66.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_ef3bca3ec6c7cb7a28ab5dc5e330db66.jpg saved to cache
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_0c672f54cc1898e7089b1ee76a28240f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0c672f54cc1898e7089b1ee76a28240f.jpg not downloaded yet
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_05fac672f18fe060c82aff8bf1e839eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_05fac672f18fe060c82aff8bf1e839eb.jpg not downloaded yet
2025-12-05 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_35079b3133cd0ec12dd49e234b7b4412.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_1a3e8d6df0a8d93c8e37bd6e1d850bdb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_fad245dce7a4b079e5b7bd2f70cc3bb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fad245dce7a4b079e5b7bd2f70cc3bb1.jpg not downloaded yet
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_17d6f4d876355aac149ffbe29a518f61.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_17d6f4d876355aac149ffbe29a518f61.jpg not downloaded yet
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_e319b45e296cc4b9298e7f380acd752f.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_e319b45e296cc4b9298e7f380acd752f.jpg not downloaded yet
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_bd888c436faa05555e5e6d8548e37a12.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_bd888c436faa05555e5e6d8548e37a12.jpg not downloaded yet
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae032a250>
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_e5b7c2f99a938a0d278b893045e2e0e3.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_e5b7c2f99a938a0d278b893045e2e0e3.jpg saved to cache
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01b44d0>
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_213c006b186a7e13318f39822bbdbf4f.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_213c006b186a7e13318f39822bbdbf4f.jpg saved to cache
2025-12-05 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01885d0>
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_3156bfb08bc04389dd29769fd874e6ad.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_3156bfb08bc04389dd29769fd874e6ad.jpg saved to cache
2025-12-05 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_cc25d467588298c0b5331432ded7fcf3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7e165a7ad46d73bd0e12ae776a34926e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_1b89d353c8e4fab5a518d23030430f32.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_89019059869e5fd4d2b28d46a39575d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_3edc43abfec12eab4c781c40570f803f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae2709d10>
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_35079b3133cd0ec12dd49e234b7b4412.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_35079b3133cd0ec12dd49e234b7b4412.jpg saved to cache
2025-12-05 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3635b10>
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_1a3e8d6df0a8d93c8e37bd6e1d850bdb.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_1a3e8d6df0a8d93c8e37bd6e1d850bdb.jpg saved to cache
2025-12-05 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_b384c8779b7f556146d01278d5cee406.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_46e0accc521ef0f5a951576b086acb14.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05ce110>
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_cc25d467588298c0b5331432ded7fcf3.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_cc25d467588298c0b5331432ded7fcf3.jpg saved to cache
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0531b50>
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_7e165a7ad46d73bd0e12ae776a34926e.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7e165a7ad46d73bd0e12ae776a34926e.jpg saved to cache
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae009c450>
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_1b89d353c8e4fab5a518d23030430f32.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_1b89d353c8e4fab5a518d23030430f32.jpg saved to cache
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0533790>
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_89019059869e5fd4d2b28d46a39575d6.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_89019059869e5fd4d2b28d46a39575d6.jpg saved to cache
2025-12-05 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae017d550>
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_3edc43abfec12eab4c781c40570f803f.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_3edc43abfec12eab4c781c40570f803f.jpg saved to cache
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_4b89a312bfa43ebb10c97c19e3ac37fe.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_2d992a95e18063b554924b20a9147a87.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_411c691605fd392324b7014391446762.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0565090>
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_b384c8779b7f556146d01278d5cee406.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_b384c8779b7f556146d01278d5cee406.jpg saved to cache
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0131010>
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_46e0accc521ef0f5a951576b086acb14.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_46e0accc521ef0f5a951576b086acb14.jpg saved to cache
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_05fac672f18fe060c82aff8bf1e839eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_e319b45e296cc4b9298e7f380acd752f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_bd888c436faa05555e5e6d8548e37a12.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03415d0>
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_4b89a312bfa43ebb10c97c19e3ac37fe.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_4b89a312bfa43ebb10c97c19e3ac37fe.jpg saved to cache
2025-12-05 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0120c50>
2025-12-05 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_2d992a95e18063b554924b20a9147a87.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_2d992a95e18063b554924b20a9147a87.jpg saved to cache
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0567090>
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_411c691605fd392324b7014391446762.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_411c691605fd392324b7014391446762.jpg saved to cache
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fad245dce7a4b079e5b7bd2f70cc3bb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_44277b369e35c5e2b6b92c57be74bca8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0121d90>
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_05fac672f18fe060c82aff8bf1e839eb.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_05fac672f18fe060c82aff8bf1e839eb.jpg saved to cache
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0472050>
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_e319b45e296cc4b9298e7f380acd752f.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_e319b45e296cc4b9298e7f380acd752f.jpg saved to cache
2025-12-05 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0471350>
2025-12-05 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_bd888c436faa05555e5e6d8548e37a12.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_bd888c436faa05555e5e6d8548e37a12.jpg saved to cache
2025-12-05 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_23a669e1d912af7b153c9e663169b9a4.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0c672f54cc1898e7089b1ee76a28240f.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:24 [scrapy.extensions.logstats] INFO: Crawled 498 pages (at 12 pages/min), scraped 177 items (at 12 items/min)
2025-12-05 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_4fa11fa3dcb4732a0b7b818d959080b1.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0264410>
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_fad245dce7a4b079e5b7bd2f70cc3bb1.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fad245dce7a4b079e5b7bd2f70cc3bb1.jpg saved to cache
2025-12-05 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3634ad0>
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_44277b369e35c5e2b6b92c57be74bca8.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_44277b369e35c5e2b6b92c57be74bca8.jpg saved to cache
2025-12-05 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_031e630dd3be8f5907452e671c004aea.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3b0321e2d7c1559bd64b2562df1fb0d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_83197c4b8f57600cba03e9093ffe381e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad368e650>
2025-12-05 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_23a669e1d912af7b153c9e663169b9a4.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_23a669e1d912af7b153c9e663169b9a4.jpg saved to cache
2025-12-05 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae033f3d0>
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_0c672f54cc1898e7089b1ee76a28240f.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0c672f54cc1898e7089b1ee76a28240f.jpg saved to cache
2025-12-05 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02d44d0>
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_4fa11fa3dcb4732a0b7b818d959080b1.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_4fa11fa3dcb4732a0b7b818d959080b1.jpg saved to cache
2025-12-05 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_ed7816526e0765e9236a50f433b1f6f6.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_90783b72f6f807053c5ff9a9846bc30c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fdbb80656d5c24d0b7dd0287b8ed8021.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f5650>
2025-12-05 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_031e630dd3be8f5907452e671c004aea.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_031e630dd3be8f5907452e671c004aea.jpg saved to cache
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f1190>
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_3b0321e2d7c1559bd64b2562df1fb0d3.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3b0321e2d7c1559bd64b2562df1fb0d3.jpg saved to cache
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0484b10>
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_83197c4b8f57600cba03e9093ffe381e.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_83197c4b8f57600cba03e9093ffe381e.jpg saved to cache
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0f2a0bd313258e13b3c836c91564d2e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_f33243f4b8242dd025ea4d7b4c0ab49a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_a2ea60be7f7b353759826d8f8f98bb44.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3738ff31547191b7ea3c2c78282f7870.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae242b290>
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_ed7816526e0765e9236a50f433b1f6f6.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_ed7816526e0765e9236a50f433b1f6f6.jpg saved to cache
2025-12-05 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3637350>
2025-12-05 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_90783b72f6f807053c5ff9a9846bc30c.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_90783b72f6f807053c5ff9a9846bc30c.jpg saved to cache
2025-12-05 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03abd10>
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_fdbb80656d5c24d0b7dd0287b8ed8021.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fdbb80656d5c24d0b7dd0287b8ed8021.jpg saved to cache
2025-12-05 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_0e8c6622508ec91e0fbe22c320b93343.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_3ed57cb161914ed9cdad42b6b7697f35.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_9be25c1f9188099039be562b1dfcd9d3.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae016a090>
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_0f2a0bd313258e13b3c836c91564d2e2.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0f2a0bd313258e13b3c836c91564d2e2.jpg saved to cache
2025-12-05 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0634750>
2025-12-05 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_f33243f4b8242dd025ea4d7b4c0ab49a.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_f33243f4b8242dd025ea4d7b4c0ab49a.jpg saved to cache
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae00f7250>
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_a2ea60be7f7b353759826d8f8f98bb44.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_a2ea60be7f7b353759826d8f8f98bb44.jpg saved to cache
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae05b5b50>
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_3738ff31547191b7ea3c2c78282f7870.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3738ff31547191b7ea3c2c78282f7870.jpg saved to cache
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_4b742598e5bbdc25d363bdd28817c6a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3709990>
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_0e8c6622508ec91e0fbe22c320b93343.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_0e8c6622508ec91e0fbe22c320b93343.jpg saved to cache
2025-12-05 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_2c37c8a433f6d549c4bfedfb9260c088.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_66b769fef5b61ba1811a7f93a07ccfb0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae056bf50>
2025-12-05 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_3ed57cb161914ed9cdad42b6b7697f35.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_3ed57cb161914ed9cdad42b6b7697f35.jpg saved to cache
2025-12-05 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae03e1b50>
2025-12-05 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fe1%252Fa5e188c5e60f7d2e6e71d4866af7b89f%252Fpa%252FFR37481_9be25c1f9188099039be562b1dfcd9d3.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_9be25c1f9188099039be562b1dfcd9d3.jpg saved to cache
2025-12-05 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2b5030f-c480-5080-a2f0-67331b1e71a9
2025-12-05 20:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2b5030f-c480-5080-a2f0-67331b1e71a9, skipping ID generation
2025-12-05 20:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b5030f-c480-5080-a2f0-67331b1e71a9 with scrape type 1
2025-12-05 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d2b5030f-c480-5080-a2f0-67331b1e71a9 from tracking dictionaries
2025-12-05 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2b5030f-c480-5080-a2f0-67331b1e71a9 sending to next pipeline
2025-12-05 20:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d2b5030f-c480-5080-a2f0-67331b1e71a9, identifier: FR37481
2025-12-05 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d2b5030f-c480-5080-a2f0-67331b1e71a9 with identifier: FR37481
2025-12-05 20:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d2b5030f-c480-5080-a2f0-67331b1e71a9 with identifier: FR37481
2025-12-05 20:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d2b5030f-c480-5080-a2f0-67331b1e71a9 with identifier: FR37481 to the API
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_9be25c1f9188099039be562b1dfcd9d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:24:16Z',
 'fuel_type': 'diesel',
 'id': 'd2b5030f-c480-5080-a2f0-67331b1e71a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR37481',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 120136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_3ed57cb161914ed9cdad42b6b7697f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_9be25c1f9188099039be562b1dfcd9d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0f2a0bd313258e13b3c836c91564d2e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_213c006b186a7e13318f39822bbdbf4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_f33243f4b8242dd025ea4d7b4c0ab49a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fdbb80656d5c24d0b7dd0287b8ed8021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_ed7816526e0765e9236a50f433b1f6f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_90783b72f6f807053c5ff9a9846bc30c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_83197c4b8f57600cba03e9093ffe381e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_4b89a312bfa43ebb10c97c19e3ac37fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_031e630dd3be8f5907452e671c004aea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_23a669e1d912af7b153c9e663169b9a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_0c672f54cc1898e7089b1ee76a28240f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_fad245dce7a4b079e5b7bd2f70cc3bb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2b5030f-c480-5080-a2f0-67331b1e71a9/d2b5030f-c480-5080-a2f0-67331b1e71a9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/e1/a5e188c5e60f7d2e6e71d4866af7b89f/pa/FR37481_e319b45e296cc4b9298e7f380acd752f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2019}
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR37481%27 HTTP/1.1" 200 None
2025-12-05 20:08:30 [auto1.it] INFO: Saving data for FR37481: {'created_time': 1764965310.445999, 'last_price_update_time': 1764965310.446014, 'auction_closing_time': 1765038256.0}
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FR37481') HTTP/1.1" 204 0
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae2740610>
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_4b742598e5bbdc25d363bdd28817c6a0.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_4b742598e5bbdc25d363bdd28817c6a0.jpg saved to cache
2025-12-05 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_9a8629769b6cab7280617e804cf9ff18.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_b2f46cbc5c0caa32691ea3753750e3b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae018bed0>
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_2c37c8a433f6d549c4bfedfb9260c088.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_2c37c8a433f6d549c4bfedfb9260c088.jpg saved to cache
2025-12-05 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f2390>
2025-12-05 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_66b769fef5b61ba1811a7f93a07ccfb0.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_66b769fef5b61ba1811a7f93a07ccfb0.jpg saved to cache
2025-12-05 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f8f4a5c7fbb0fbaf64f0c0e1ab3a84a0.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_17d6f4d876355aac149ffbe29a518f61.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01225d0>
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_9a8629769b6cab7280617e804cf9ff18.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_9a8629769b6cab7280617e804cf9ff18.jpg saved to cache
2025-12-05 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad365d910>
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_b2f46cbc5c0caa32691ea3753750e3b8.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_b2f46cbc5c0caa32691ea3753750e3b8.jpg saved to cache
2025-12-05 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_bb66be48592f356bc450b9e9cb41946c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_524121cb7d78e562c0c945990e762819.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36f1350>
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_f8f4a5c7fbb0fbaf64f0c0e1ab3a84a0.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f8f4a5c7fbb0fbaf64f0c0e1ab3a84a0.jpg saved to cache
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae043df10>
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_17d6f4d876355aac149ffbe29a518f61.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_17d6f4d876355aac149ffbe29a518f61.jpg saved to cache
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_ca779719739a839fe80f04ddec4cb986.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad3672a90>
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_bb66be48592f356bc450b9e9cb41946c.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_bb66be48592f356bc450b9e9cb41946c.jpg saved to cache
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad368c050>
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F3d%252F283daf454d7052c5bbf429a26b7181dd%252Fpa%252FGZ43068_524121cb7d78e562c0c945990e762819.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_524121cb7d78e562c0c945990e762819.jpg saved to cache
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e06b709-0901-5d98-b929-eb3d054ad2b9
2025-12-05 20:08:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e06b709-0901-5d98-b929-eb3d054ad2b9, skipping ID generation
2025-12-05 20:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e06b709-0901-5d98-b929-eb3d054ad2b9 with scrape type 1
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3e06b709-0901-5d98-b929-eb3d054ad2b9 from tracking dictionaries
2025-12-05 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e06b709-0901-5d98-b929-eb3d054ad2b9 sending to next pipeline
2025-12-05 20:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e06b709-0901-5d98-b929-eb3d054ad2b9, identifier: GZ43068
2025-12-05 20:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 with identifier: GZ43068
2025-12-05 20:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 with identifier: GZ43068
2025-12-05 20:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181206 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181206
2025-12-05 20:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3e06b709-0901-5d98-b929-eb3d054ad2b9 spider: auto1.it
2025-12-05 20:08:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3e06b709-0901-5d98-b929-eb3d054ad2b9 due to rule: high_mileage_for_country.json, error: 181206 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181206
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': 'Taxi',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:35:25Z',
 'fuel_type': 'diesel',
 'id': '3e06b709-0901-5d98-b929-eb3d054ad2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ43068',
 'listing': 'auction',
 'location': 'IT, San Giuliano Milanese',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 181206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_68cde55361fe9bb8857bdef151d8290d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7de0e84b1fc195274efaed46aec3f02f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_8e88107bdc045b571c43202ee9329ae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f1fe4ed76092c7dbb3e2ecf245f5c8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_7f27404a72f6a63c4f0d77422322a012.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_a86721bacd1acf01cea25a793b84e33a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_f1cdc59bae72410df3d5c33c2c2f5def.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_524121cb7d78e562c0c945990e762819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_b2f46cbc5c0caa32691ea3753750e3b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_08387f9378c7237f748539b619de7b77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_c83262db504fd9b9ac21a0208a12db73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_83898cfe953c5475ec3652441568f734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_64016d01a51ace14cff5708b1f92cdac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_66b769fef5b61ba1811a7f93a07ccfb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e06b709-0901-5d98-b929-eb3d054ad2b9/3e06b709-0901-5d98-b929-eb3d054ad2b9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/3d/283daf454d7052c5bbf429a26b7181dd/pa/GZ43068_d52b7c2f16556b4fc67734f736434087.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2019}
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ43068%27 HTTP/1.1" 200 None
2025-12-05 20:08:33 [auto1.it] INFO: Saving data for GZ43068: {'created_time': 1764965313.18673, 'last_price_update_time': 1764965313.186742, 'auction_closing_time': 1765038925.0}
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ43068') HTTP/1.1" 204 0
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad363bd50>
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_ca779719739a839fe80f04ddec4cb986.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_ca779719739a839fe80f04ddec4cb986.jpg saved to cache
2025-12-05 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_f9ccd1805b7fbac26acb2bad09cb104e.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_03426ba372d95517f0b60f9434aaf5f8.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_0111fb944396b7d87b792593bb65d86b.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_d991de58cdba2ab5a22d485f0a7c106c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_66e7e75580549e53d09d6b7de77d933c.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_5ba9e22fe8580efcacaffb945e587b3a.jpg> (referer: https://www.auto1.com/)
2025-12-05 20:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0634050>
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa2%252Fe8a2393ec016ebf8062c0f8449ed17ab%252Fpa%252FUS78737_f9ccd1805b7fbac26acb2bad09cb104e.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_f9ccd1805b7fbac26acb2bad09cb104e.jpg saved to cache
2025-12-05 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f35996f-adae-5f6c-843d-148d26ffb480
2025-12-05 20:08:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f35996f-adae-5f6c-843d-148d26ffb480, skipping ID generation
2025-12-05 20:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f35996f-adae-5f6c-843d-148d26ffb480 with scrape type 1
2025-12-05 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0f35996f-adae-5f6c-843d-148d26ffb480 from tracking dictionaries
2025-12-05 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f35996f-adae-5f6c-843d-148d26ffb480 sending to next pipeline
2025-12-05 20:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f35996f-adae-5f6c-843d-148d26ffb480, identifier: US78737
2025-12-05 20:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f35996f-adae-5f6c-843d-148d26ffb480 with identifier: US78737
2025-12-05 20:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f35996f-adae-5f6c-843d-148d26ffb480 with identifier: US78737
2025-12-05 20:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f35996f-adae-5f6c-843d-148d26ffb480 with identifier: US78737 to the API
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_f9ccd1805b7fbac26acb2bad09cb104e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2025-12-06T16:39:13Z',
 'fuel_type': 'hybrid',
 'id': '0f35996f-adae-5f6c-843d-148d26ffb480',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US78737',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Lexus',
 'model': 'UX-Serie',
 'odometer': 39714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_ef3bca3ec6c7cb7a28ab5dc5e330db66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2371699,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_f9ccd1805b7fbac26acb2bad09cb104e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_1a3e8d6df0a8d93c8e37bd6e1d850bdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_e5b7c2f99a938a0d278b893045e2e0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_89019059869e5fd4d2b28d46a39575d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_0e8c6622508ec91e0fbe22c320b93343.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2298055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3738ff31547191b7ea3c2c78282f7870.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_b384c8779b7f556146d01278d5cee406.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_3b0321e2d7c1559bd64b2562df1fb0d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_46e0accc521ef0f5a951576b086acb14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_2d992a95e18063b554924b20a9147a87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_411c691605fd392324b7014391446762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_05fac672f18fe060c82aff8bf1e839eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2488813,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_17d6f4d876355aac149ffbe29a518f61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f35996f-adae-5f6c-843d-148d26ffb480/0f35996f-adae-5f6c-843d-148d26ffb480_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a2/e8a2393ec016ebf8062c0f8449ed17ab/pa/US78737_bd888c436faa05555e5e6d8548e37a12.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus UX-Serie UX 250h Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US78737%27 HTTP/1.1" 200 None
2025-12-05 20:08:34 [auto1.it] INFO: Saving data for US78737: {'created_time': 1764965314.469229, 'last_price_update_time': 1764965314.469239, 'auction_closing_time': 1765039153.0}
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US78737') HTTP/1.1" 204 0
2025-12-05 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae02522d0>
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_03426ba372d95517f0b60f9434aaf5f8.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_03426ba372d95517f0b60f9434aaf5f8.jpg saved to cache
2025-12-05 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36a0ed0>
2025-12-05 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_0111fb944396b7d87b792593bb65d86b.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_0111fb944396b7d87b792593bb65d86b.jpg saved to cache
2025-12-05 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ad36e7710>
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fcc%252Fedccb9654a1fde1e84200eed8cbf2d77%252Fpa%252FHW41289_d991de58cdba2ab5a22d485f0a7c106c.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_d991de58cdba2ab5a22d485f0a7c106c.jpg saved to cache
2025-12-05 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c6407ff5-0f31-5e06-a95f-97b147e061b8
2025-12-05 20:08:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6407ff5-0f31-5e06-a95f-97b147e061b8, skipping ID generation
2025-12-05 20:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6407ff5-0f31-5e06-a95f-97b147e061b8 with scrape type 1
2025-12-05 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c6407ff5-0f31-5e06-a95f-97b147e061b8 from tracking dictionaries
2025-12-05 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6407ff5-0f31-5e06-a95f-97b147e061b8 sending to next pipeline
2025-12-05 20:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6407ff5-0f31-5e06-a95f-97b147e061b8, identifier: HW41289
2025-12-05 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae0252c10>
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_66e7e75580549e53d09d6b7de77d933c.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_66e7e75580549e53d09d6b7de77d933c.jpg saved to cache
2025-12-05 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 20:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ae01f2b10>
2025-12-05 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F7d%252F0d7d460a75db9fa6cfeb67818988386e%252Fpa%252FDZ09819_5ba9e22fe8580efcacaffb945e587b3a.jpg') HTTP/1.1" 204 0
2025-12-05 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_5ba9e22fe8580efcacaffb945e587b3a.jpg saved to cache
2025-12-05 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4
2025-12-05 20:08:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4, skipping ID generation
2025-12-05 20:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 with scrape type 1
2025-12-05 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 from tracking dictionaries
2025-12-05 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 sending to next pipeline
2025-12-05 20:08:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4, identifier: DZ09819
2025-12-05 20:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6407ff5-0f31-5e06-a95f-97b147e061b8 with identifier: HW41289
2025-12-05 20:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6407ff5-0f31-5e06-a95f-97b147e061b8 with identifier: HW41289
2025-12-05 20:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6407ff5-0f31-5e06-a95f-97b147e061b8 with identifier: HW41289 to the API
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_d991de58cdba2ab5a22d485f0a7c106c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:41:21Z',
 'fuel_type': 'diesel',
 'id': 'c6407ff5-0f31-5e06-a95f-97b147e061b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW41289',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 102375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3074551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_3edc43abfec12eab4c781c40570f803f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_ca779719739a839fe80f04ddec4cb986.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_f88936af93ff6586b7bf5c2d1f7a024a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_bf228d7cb05f7516668f1a7104c5b0d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_746177f8d0e9075f4e98fdf062e272b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_20856989e074eaa6bcd9177ef5461349.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009416,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_44277b369e35c5e2b6b92c57be74bca8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_532db61e5e2bfb4454dd9580087070ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3050116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_4fa11fa3dcb4732a0b7b818d959080b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_03426ba372d95517f0b60f9434aaf5f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3029770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_d991de58cdba2ab5a22d485f0a7c106c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3054994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_0111fb944396b7d87b792593bb65d86b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_1b89d353c8e4fab5a518d23030430f32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_35079b3133cd0ec12dd49e234b7b4412.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6407ff5-0f31-5e06-a95f-97b147e061b8/c6407ff5-0f31-5e06-a95f-97b147e061b8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/cc/edccb9654a1fde1e84200eed8cbf2d77/pa/HW41289_a2ea60be7f7b353759826d8f8f98bb44.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW41289%27 HTTP/1.1" 200 None
2025-12-05 20:08:37 [auto1.it] INFO: Saving data for HW41289: {'created_time': 1764965317.093815, 'last_price_update_time': 1764965317.093825, 'auction_closing_time': 1765039281.0}
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW41289') HTTP/1.1" 204 0
2025-12-05 20:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 with identifier: DZ09819
2025-12-05 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 with identifier: DZ09819
2025-12-05 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160032 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160032
2025-12-05 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 spider: auto1.it
2025-12-05 20:08:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 95b5bfbe-1ce4-58f9-ab1c-feae05d884c4 due to rule: high_mileage_for_country.json, error: 160032 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160032
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:48:23Z',
 'fuel_type': 'diesel',
 'id': '95b5bfbe-1ce4-58f9-ab1c-feae05d884c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ09819',
 'listing': 'auction',
 'location': 'IT, Corte Stanghellini (Capannori)',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 160032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_47050760759655c873e8387a9f5e4018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_3156bfb08bc04389dd29769fd874e6ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7a0022ade83abc69bb64e17e644212ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2901609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_cc25d467588298c0b5331432ded7fcf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_b6d3b6b3c5ba164d9880543cfb79c8b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_7e165a7ad46d73bd0e12ae776a34926e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_5ba9e22fe8580efcacaffb945e587b3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_bb66be48592f356bc450b9e9cb41946c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f8f4a5c7fbb0fbaf64f0c0e1ab3a84a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_9a8629769b6cab7280617e804cf9ff18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_66e7e75580549e53d09d6b7de77d933c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_a41441d616233dc65c557a5bb0caeae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_f7ead539f224c48456420c3a70994d27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_2c37c8a433f6d549c4bfedfb9260c088.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95b5bfbe-1ce4-58f9-ab1c-feae05d884c4/95b5bfbe-1ce4-58f9-ab1c-feae05d884c4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/7d/0d7d460a75db9fa6cfeb67818988386e/pa/DZ09819_4b742598e5bbdc25d363bdd28817c6a0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2017}
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ09819%27 HTTP/1.1" 200 None
2025-12-05 20:08:37 [auto1.it] INFO: Saving data for DZ09819: {'created_time': 1764965317.432616, 'last_price_update_time': 1764965317.432643, 'auction_closing_time': 1765039703.0}
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DZ09819') HTTP/1.1" 204 0
2025-12-05 20:08:37 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 20:08:37 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2}
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201764533317 HTTP/1.1" 200 None
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FW88159') HTTP/1.1" 204 0
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HN66852') HTTP/1.1" 204 0
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='LS57979') HTTP/1.1" 204 0
2025-12-05 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YS70016') HTTP/1.1" 204 0
2025-12-05 20:08:37 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (180 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_75_2025-12-05T20_00_00.jl
2025-12-05 20:08:37 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 2423042,
 'downloader/request_count': 1416,
 'downloader/request_method_count/GET': 1398,
 'downloader/request_method_count/POST': 18,
 'downloader/response_bytes': 538842609,
 'downloader/response_count': 1416,
 'downloader/response_status_count/200': 1416,
 'dupefilter/filtered': 32,
 'elapsed_time_seconds': 494.085864,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 20, 8, 37, 676348, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 57,
 'item_dropped_reasons_count/DropItem': 57,
 'item_scraped_count': 180,
 'log_count/DEBUG': 14093,
 'log_count/INFO': 12198,
 'memusage/max': 192368640,
 'memusage/startup': 127188992,
 'photo_download_count': 922,
 'request_depth_max': 19,
 'response_received_count': 494,
 'scheduler/dequeued': 1416,
 'scheduler/dequeued/memory': 1416,
 'scheduler/enqueued': 1416,
 'scheduler/enqueued/memory': 1416,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 494,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.932024352753965,
 'scrapy-zyte-api/mean_response_seconds': 3.948396313183766,
 'scrapy-zyte-api/processed': 494,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 494,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 493,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 494,
 'scrapy-zyte-api/request_args/httpRequestBody': 18,
 'scrapy-zyte-api/request_args/httpRequestMethod': 18,
 'scrapy-zyte-api/request_args/httpResponseBody': 494,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 494,
 'scrapy-zyte-api/request_args/sessionContext': 494,
 'scrapy-zyte-api/request_args/url': 494,
 'scrapy-zyte-api/status_codes/200': 494,
 'scrapy-zyte-api/success': 494,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 5, 20, 0, 23, 590484, tzinfo=datetime.timezone.utc)}
2025-12-05 20:08:37 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 20:08:37 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5ae2626090>
2025-12-05 20:08:37 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5ae2394390>